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Preface 


This book evolved from a one-year Advanced Calculus course that we have given during the last 
decade. Our audiences have included junior and senior majors and honors students, and, on occasion, 
gifted sophomores. 

The material is logically self-contained; that is, all of our results are proved and are ultimately 
based on the axioms for the real numbers. We do not use results from other sources, except for a few 
results from linear algebra which are summarized in a brief appendix. Thus, theoretically, no 
prerequisites are necessary to understand this material. Realistically, the prerequisite is some 
mathematical maturity such as one might acquire by taking calculus and, perhaps, linear algebra. 

Our intent is to teach students the tools of modern analysis as it relates to further study in 
mathematics, especially statistics, numerical analysis, differential equations, mathematical analysis, 
and functional analysis. 

It is our belief that the key to a sound foundation for the study of analysis lies in an understanding of 
the limit concept. Thus, after initial chapters on sets and the real number system, we introduce the 
limit concept using numerical sequences and series (Chapters IV and V). This is followed by Chapter 
VI on the limit of a function. We then move to the general setting of metric spaces (Chapter VII). 
Chapter VIII is a review of differential calculus. Chapter IX gives a detailed introduction to the 
theory of Riemann-Stieltjes integration. We then turn to the study of sequences and series of functions 
(Chapters X and XI), Fourier series (Chapter XII), the Riesz representation theorem (Chapter XIII), 
and the Lebesgue integral (Chapter XIV). The first seven chapters could be used for a one-term 
course on the Concept of Limit. 

Because we believe that an essential part of learning mathematics is doing mathematics, we have 
included over 750 exercises, some containing several parts, of varying degrees of difficulty. Hints 
and solutions to selected exercises, indicated by an asterisk, are given at the back of the book. 

We would like to thank our colleagues, Dr. Rosalind Reichard, who taught this course from a 
preliminary version and gave us useful information, and Dr. Keith Rose, who read the manuscript and 
offered valuable criticism. Thanks also to our many students who studied this material and offered 
suggestions, and especially Mr. James Africh, who worked nearly every exercise and made many 
helpful comments. Our thanks also go to the secretarial staff at the University of Victoria, who over 
the years typed various versions of the manuscript. Of course, we assume joint responsibility for the 
book's strengths and weaknesses, and we welcome comment. 


Richard Johnsonbaugh 
W. E. Pfaffenberger 


Preface to the Dover Edition 


Foundations of Mathematical Analysis covers real analysis—from naive set theory and the axioms 
for the real numbers to the Lebesgue integral, with sequences and series, metric spaces, the Riemann- 
Stieltjes integral, inner product spaces, Fourier series, Tauberian theorems, the Riesz representation 
theorem, and a brief discussion of Hilbert spaces in between. 

The book evolved from a one-year Advanced Calculus course that both authors taught during the 
late 1960s and throughout the 1970s. The audience included junior and senior majors and honors 
students, and, on occasion, gifted sophomores. Professor Pfaffenberger has continued to teach this 
course. (Professor Johnsonbaugh moved to computer science.) The intervening years have confirmed 
the importance of real analysis. Analysis is a core subject in mathematics and is a prerequisite for 
further study in mathematics. Analysis is also fundamental to many related fields such as statistics. 
Several of Professor Pfaffenberger's students have completed doctorates at distinguished institutions 
(e.g., Princeton, Harvard, Berkeley, Cambridge), and many have specialized in analysis. 

Because we believe that an essential part of learning mathematics is doing mathematics, we have 
included over 750 exercises, some containing several parts, of varying degrees of difficulty. Hints 
and solutions to selected exercises, indicated by an asterisk, are given in the back of the book. 

We will maintain a World Wide Web site for this reprint that contains additional problems, errata, 
and other supplementary material. 


About This Book 


The material is logically self-contained; that is, all of our results are proved and are ultimately based 
on the axioms for the real numbers. We do not use results from other sources except for a few results 
from linear algebra that are summarized in a brief appendix. Thus, logically, no prerequisites are 
necessary to understand this material. Realistically, the prerequisite is some mathematical maturity 
such as one might acquire by taking calculus and, perhaps, linear algebra. 

It is our belief that understanding the limit concept is the key to a sound foundation for the study of 
analysis. Thus, after initial chapters on sets and the real number system (Chapters I-III), we introduce 
the limit concept using numerical sequences and series (Chapters IV and V). Chapter VI then covers 
the limit of a function. Theorem 16.6 in Chapter IV contains an interesting proof that {(1 + 1/n)"} is 
increasing and convergent. A discussion of double series (Section 29) leads to a quick proof that a 
rearrangement of an absolutely convergent series converges and the sum of the rearranged series is 
equal to the sum of the original series (Theorem 29.7). Double series are also used to discuss the 
Cauchy product of two series (Theorem 29.9) and to give some results on power series (Corollary 
29.10 and Theorem 29.11). 

In Chapter VII, we move to the general setting of metric spaces. Results include the Bolzano- 
Weierstrass characterization of a compact metric space (Section 43) and the Baire category theorem 
(Section 47). The first seven chapters could be used for a one-term course on the Concept of Limit. 

After a review of differential calculus (Chapter VIII), Chapter IX gives a detailed introduction to 


the theory of Riemann-Stieltjes integration. We discuss measure zero (Section 57) and give a 
necessary and sufficient condition for the existence of the Riemann integral (Section 58). 

We then turn to the study of sequences and series of functions (Chapter X). We provide applications 
to power series (Section 63) and Abel's limit theorems (Section 64). We also discuss summability 
methods and Tauberian theorems (Section 65). 

Chapter XI discusses the exponential, logarithm, and trigonometric functions. The exponential, 
sine, and cosine functions are defined by power series, after which their standard properties are 
derived. The other trigonometric functions are defined in terms of the sine and cosine functions, and 
the logarithm function is defined as the inverse of the exponential function. 

Inner product spaces and Fourier series are the topics for Chapter XII. Included is a discussion of 
Cesaro summability (Section 77) and Hardy's Tauberian theorem (Theorem 79.1) with an application 
to Fourier series (Theorem 79.3). 

Chapter XIII develops normed linear spaces and proves the following version of the Riesz 
representation theorem (Theorem 84.1), where C[a, b] is the set of continuous functions on [a, b]: If 7 
is a continuous linear functional on C[a, 5], then there exists a function of bounded variation a on [a, 
b] such that 


b 
T(f) = j. fd forall f €C{a,b). 


Furthermore, the norm of 7 is equal to the total variation of a on [a, 5]. 

The last chapter (Chapter XIV) studies the Lebesgue integral. Topics include measurable functions 
(Section 87), integration on positive measure spaces (Section 88), and Lebesgue measure (Sections 
89 and 90). The concluding section (Section 91) introduces Hilbert spaces and proves the Riesz- 
Fischer theorem (Theorem 91.9). 

The book concludes with an appendix on vector spaces, a list of references, and hints to selected 
exercises. The appendix summarizes some of the key definitions and theorems concerning vector 
spaces that are used in the book. 


Examples 


The book contains nearly 100 worked examples. These examples clarify the theory, show students 
how to develop proofs, demonstrate applications of the theory, elucidate proofs, and help motivate 
the material. 


World Wide Web Site 


The World Wide Web site 
http://condor.depaul.edu/~rjohnson 
contains 


¢ Expanded explanations of particular topics and further information on analysis. 
¢ Additional exercises. 
¢ An errata list. 
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Sets and Functions 


In this brief chapter we will summarize some of the fundamental notation and definitions which will 
be used throughout the text. 


1. Sets 


As a Starting point we describe what we mean by a set. We will not attempt to define the term set, but 
we demonstrate the use of the term by examples. The term set is used (roughly) to describe any 
collection of objects. For example, the set whose objects are the positive integers 1, 2, 3 may be 
denoted 


Seomes 
If a set consists of a finite number of objects, we may denote the set by listing its objects. If a set 
consists of infinitely many objects such a listing is impossible. In this case we may describe the set by 
naming a property common to all the objects in the set. For example, to describe the set of positive 
integers, we use the notation 

{x |x 1S a positive integer} 


Go 99 


This notation is read “the set of all x such that x is a positive integer.” (The bar “ |’ is read “such 
that.”) In general, to describe the set of all objects having a particular property P, we write 


{x |x has property P} 
Ifx is an object ina set A, we write 
x€A 
and say that x is an element (or a point) of A. If x is not an element of the set A, we write 
x¢A 


For example, if Z denotes the set of integers, then 1 € Z, but4 ¢ Z. 


We shall say two sets A and B are equal and write A = B if A and B have the same elements. Thus A 
= B if whenever x € A, thenx € B, and whenever x € B, then x € A. 


Definition 1.1. If A and B are sets, the union of A and B 1s the set 
AU B= {xjx €Aorx€ B} 
The intersection of A and B 1s the set 
AN B= {xjx € Aorx € B} 
For example, if A = {1, 2,3} and B= {2, 3, 4}, then 
A U B= 41, 2, 3, 4} 
AN B= {2, 3} 


We may extend the definitions of union and intersection to more than two sets as follows. If ¢ is a 
collection of sets, we define 


Uw = {xjx € A for some 4 € yw} 


Naw = {x|x € A for some A E wv} 


In case the family . is indexed by the positive integers, w= {A,, A,, A;,...}, we write 


For example, if 
a = {A, A,,...} 


where A, =41}, 4,={]L2}.5,5 4,2 (1)2.6, 0} yc 
then nd = 0) A,={l} Ut= UA, 
nm=1 n=1 


is the set of positive integers. 
Definition 1.2. The empty set is the set with no elements and is denoted 9. 


Definition 1.3. If every element of the set A is an element of the set B, we write A C B and say that 
A is contained in B or that A is a subset of B. 
We write B D AifA C B and say that B contains A. 


We note that according to Definition 1.3, 4 C B allows the possibility that A = B. It follows 


immediately from our definitions that A = B if and only if A C B and B C A. We call A a proper 
subset of BifA C Band AFB. 


Definition 1.4 If A and B are sets, the difference of A and B is the set 
A\B= {xix €AorxeB} 
For example, if A= {1, 2,3} and B= {2, 3, 4}, then A\B= {1}. 
If we are working with sets all of which are subsets of some particular set U, we sometimes say 


that U is the universe in which we are working. For example, if we are working with sets of integers, 
we could agree that the universe U is the set Z of all integers. 


Definition 1.5 If we are working ina fixed universe U, and A C U, we write 
'=U\A 


The set U\A is called the complement of A relative to U (or just simply the complement of A if the 
universe U is understood). 


For example, if U is the set of real numbers, we would state that the complement of the set of 
rational numbers is the set of irrational numbers. 

We now prove two theorems which are known as De Morgan's laws. These theorems can often be 
used to convert a statement about unions into a statement about intersections and vice versa. 


Theorem1.6 If 4 and B are subsets of a universe U, then 
(AU BY=ANB (AN B)=A UB 


Proof. We prove only the first equation leaving the second as an exercise. 
Letx € (A U B)’. Thenx ¢(A U B), and hence x ¢ A and x ¢ B. Thus x € A’ and x € B' which 
implies x € A’ | B’. Therefore, 


(4 U BY =A'N B" 


Next suppose x € A’ (1) B’. Then x € A’ and x € B’, and hence x ¢ A and x ¢ B. Thus x ¢ A U B, 
which implies x € (A U B)'. Therefore, 


A'N B'C (A UBY' 


which completes the proof. g 
In a similar way one may prove the following theorem. 


Theorem1.7 Let .v be a collection of subsets of a universe U, and let 


a ={a'\AE og} 


Then (Ue) =n’ (nsf) = Ul’ 
Exercises 
1.1 Let U= {1, 2, 3,4, 5, 6, 7, 8,9, 103 
A= {1, 2, 3, 4} 
B= {1, 3,5, 7, 9} 
Compute the following sets: 
(a) AUB 
(b) ANB 
(c) A\B 
(d) B\A 
(ce) A’ 
(f) B 
1.2 Prove the second equation of Theorem 1.6. 


1.3 


1.4 
1.5 
1.6 
1.7 
1.8 
1.9 
1.10 
1.11 
1.12 
1.13 
1.14 


Prove Theorem 1.7. 

In exercises 4 to 13, A, B, and C are all subsets of a universe U. 
Prove: A C @ ifand only if A= 9 

Prove: IfA C Band B C C, thend C C 

Prove: 4d UB=BUA 

Prove: AU (BU C)=(A UB) UC 

Prove: AN (BU C)=(AN B) U (ANC) 

Prove: A U (BN C)=(AU B)N(ANC) 

Prove: (4')'=A 

Prove: If A C B, then B’ C A’ 

Prove: Af A'=@ 

Prove: A ¢ B ifand only if A 9 B’ # @ (¢ means “is not a subset of’) 
Let U be a universe. Let A be a subset of U and let xv be a collection of subsets of U. Prove: 
(a) Anus) =U {An X| Xe} 


(b) AU(aw) =n {AUX| Xew} 


2. Functions 


The concept of a function is central to all of mathematics, and in this section we will give a precise 
definition of a function and prove several properties of functions. We begin with the concept of an 
ordered pair. 


Definition 2.1 The ordered pair of elements a and 5, written (a, b), is the set 


(a,b) = {ia}, ta DS} 


a is called the first element of (a, b) and b is called the second element of (a, b). 

The crucial property of an ordered pair is stated in the next theorem. The theorem states that two 
ordered pairs are identical if and only if they have the same first elements and the same second 
elements. 


Theorem2.2 Let (a, b) and (c, d) be ordered pairs. Then (a, b) = (c, d) if and only if a =c and b = 
d. 


Proof. Suppose a = c and b = d. Then {a} = {c} and {a, b} = {c, d}, and therefore (a, b) =(c, d). 
Conversely, suppose (a, b) = (c, d). Then 


Lig, 1& Dey = tieg, te A521) 


First, we consider the case that a = b. Now 
a,b= {1a}, 14, DS} = (a3, tah} = tah} 
and so {ic}, tc a3} = {tap} 


Thus {a} = {c} = {c, d}, and therefore a =b =c =d. 

Now suppose a # b. From equation (2.1) we see that either {c} = {a} or {c} = {a, b}. Since ab, 
we must have {c} = {a}, which implies that a = c. Again using equation (2.1), we have that either {a, 
b} = {c} or {a, b} = {c, d}. If {a, b} = {c}, then a = b =c, whichis not the case, and thus {a, b} = 
{c, d\. It follows that b = c or b = d, but if b = c, we would have the contradiction b = c = a. 
Therefore b = d, and we have established the theorem. g 


Definition 2.3 IfX and Yare sets, the Cartesian product of X and Y denoted X x Y is the set 
Xx Y= {(x% y)jx € Xandy € VY} 


Definition 2.4 LetX and Ybe sets. A function from_X into Yis a subset fof X x Y satisfying 
(i) If (x, y) and (x, y’) belong to f, then y = y’. 
(1) Ifx €_X, then (x, y) € ffor some y € Y. 
Iffis a function from_X into Y, we will write f: X¥ — Y. 
The crucial property of a function from X into Y is that with each [2.4(11)] element x in_X there is 
associated a unique [2.4(i)] element y in Y. 


Definition 2.5 Let /fbe a function from X into Y. LetA C Xand BC Y. 

(i) X1s called the domain of f. Yis called the codomain of f. 

(ii) If (x,y) € f, we write y = f(x) and call y the (direct) image of x under f. 
(111) The range of fis the set 


UG) [x € X} 


(iv) The image of A under fis the set f(A) = {f(x) |x € A}. 
(v) The inverse image of B under f is the set 


f(B) = Xx fo) © BS 
(vi) fis onto Yif f(X) = Y. 
(vil) fis one to one if f(x) = f(x’) always implies that x = x' for x, x’ €.X. 


If f is a one-to-one function from XY into Y, we may define the inverse function to f, denoted f', 
from the range of f onto_X by the rule 


(y, x) € f' if and only if (x, y) € f 


Notice that the function f~' is defined only if fis one to one but that f~'(B) is defined for an arbitrary 
function f and for all sets B C Y. 
Ifg: X — Yand f; Y— Z, we define the composition f ° g: X — Z by the rule 


(f° g)(x) = f(g(x)) for each x € X 
If fi, X > Yand A C_X, we define the function 
fi A= {(% v) € fix € A} 


fA 1s called the restriction of f to A, and fis said to an extension of f| A to X. 
We illustrate the preceding definitions with an example. 


Example. Let 
f= 10, D, 2, 1), 3,9}, 4=10, 2}, B= th 
The domain of fis {1, 2, 3} and the range of fis {1, 4}. The image of A under fis the set f(A) = {1}. 


The inverse image of B under fis the set f~'(B) = {1, 2}. If we let Y= {1, 4}, fis onto Y. The function 
f is not one to one. The restriction of f to A is the function 


fIA= iL, 1), 2, D} 
Let g= it, 1), @, 3)} 
Then g is one to one and the inverse function to g is the function 


g'= id, 1), G, 2)5 


The composition f° g is the function 


feg= id, I), 2; 45 


The next theorem establishes several properties of inverse and direct images. 


Theorem2.6 Let /fbe a function from _X into Y. Let ¢ be a collection of subsets of X, and let ¢g be a 
collection of subsets of Y. Let C € Y. 
Then 


(1) f(ust) = Uff(4)| A ext} 
(i) f-(U) = Uf{f-(C)| Ce @} 
(il) fn) = n{f7(C)| Cee} 
Gv) fi (C)=f (OY 
Proof. We prove part (ii) only. Letx € f'( Ug). Then f(x) € U g, and thus f(x) € C, for some C, 
€ ¢. Thus x € f (C,), and therefore x € U {f"(C): C € ¢}. We have proved that 


LONE) © AFC) | Ce @} 


Now letx € U {f'(C): C € ¢}, thenx € f-"(C,) for some C, ing. Therefore f(x) € C,, and hence 
fix) € Ug. It follows that x € f-'( Ug). We have proved that 


Ulf -(C)| Ce @} <f-(U®) 
and part (11) now follows. gy 


In case w= {A, B} and ¢= {C, D} the conclusions of Theorem 2.6 may be written 


f(A v B) = f(A) Uf(B) 
f'(CuDd) =f (Chu f*D) 
f (Cand =f"*(C)of 


It is not true that in general one has f(A MN B) = f(A) 1 f(B). (Verify.) 


Exercises 


2.1 Letg= {(, 2), (2, 2), (3, 1), (4, 4)} 

f= {(1, 5), (2, 7), G9), (4, 17)} 
A= {1, 2} 

Compute 

(a) The domain of g 

(b) The range of g 

(c) g(A) 

(d) g (4) 


2.2 
2.3 


2.4 
25 


2.6 


(e)feg 
(Hf 


Leth: X > Y,g: Y— Z, and f: Z— W. Prove that (f° g) °h=fe (ge h). 


Let f: X > Yand A C Xand B C Y. Prove 


(a) ff "(B)) © B 
(b) AC f '(f(B)) 


Prove Theorem 2.6 (1), (111), and (iv). 


Let g: X > Yandf: Y— Z. 


(a) Prove that if g and f are one-to-one functions, then f° g is a one-to-one function and (f° g) 


Ta glo fol, 


(b) Prove that if g and fare onto functions, then f° g is an onto function. 


(c) Prove that if A C Z, then (f° g) '(A)=2 '(f '(A)). 


Let f: X — Y. Prove that fis a one-to-one function if and only if 


for all subsets A and B of X. 


{AN B)= fA) flB) 


ll 
The Real Number System 


The central topic of study in this text is the real number system. We will define the real numbers by 
specifying which axioms or rules the real numbers are assumed to satisfy. In an appropriate theory of 
sets, one may construct a number system which satisfies these axioms [see Kelley (1955) and Landau 
(1960)]. It can be shown that these axioms determine the real numbers (see Exercise 7.9). 


3. The Algebraic Axioms of the Real Numbers 


We begin with a definition. 


Definition 3.1. A binary operation ona set X is a function from _X = X into _X. 


Intuitively, a binary operation on a set X is a rule which associates with each ordered pair of 
elements of X a unique element of X. Binary operations are often written +, -, or *, and the value of 
the function at an ordered pair (x, y) is usually written x + y, x - y, or x*y. The particular binary 
operations with which we shall be immediately concerned are addition and multiplication of real 
numbers. Addition or multiplication of real numbers associates with each ordered pair of real 
numbers (a, 5) another real number, namely the sum of a and b or the product of a and 5. 


Definition 3.2 = The real numbers R.1s a set of objects satisfying Axioms 1 to 13 as listed in the 
following: 


Axiom I. There is a binary operation called addition and denoted + such that if x and y are real 
numbers, x + y is a real number. 


Axiom 2. Addition is associative. 
(c+ Y)+Z=x+(y+z) 
for allx, yz ER. 
Axiom 3. Addition is commutative. 
XT Y=yrx 


for allx,y ER. 


Axiom 4. An additive identity exists. There exists a real number denoted 0 which satisfies 
x+0=x=0+x 
for allx € R. 


Axiom 5. Additive inverses exist. For each x € R, there exists y € Rsuch that 
xt+y=O0=ytx 


The number y of Axiom 5 may be shown to be unique, and it is denoted —x. We define x — z as x + 
(—z) for all x and zinR. 

Any mathematical system which satisfies axioms 1 to 5 is called a commutative (or abelian) 
group. Using axioms | to 5 one may establish the usual rules for addition of real numbers. We give 
one example in the next theorem and several other additive properties are given as exercises. 


Theorem3.3 The additive identity of axiom 4 is unique, that is, 1f there exists 0’ € R such that x + 
0’=x for all x € R, then 0 = 0". 


Proof. Suppose there exists 0’ € R such that x + 0'=x for all x € R. Then 0 + 0'= 0. On the other 
hand, from axiom 4 we have 0’ + 0 = 0’. Since addition is commutative (axiom 3), 


0=0+0'=0'+0=0' a 
We continue by giving the axioms for multiplication of real numbers. 


Axiom 6. There is a binary operation called multiplication and denoted such that if x and y are real 
numbers, then x - y (or xy) is a real number. 


Axiom 7. Multiplication is associative. 
(xy)z = x(yz) 
for allx, yz ER. 
Axiom 8. Multiplication is cummutative. 
xy = yx 
for allx, y ER. 


Axiom 9. A multiplicative identity exists. There exists a real number, different from 0, denoted 1 
which satisfies 


for all x in R. 


Axiom 10. Multiplicative inverses exist for nonzero real numbers. For any x € R with x # 0, there 
exists y € R such that 


xy=l=yx 
The next axiom links the operations of addition and multiplication. 


Axiom 11. Multiplication distributes over addition. 
xvytz=xytxz (ytz)x=yx+zx 


for allx,yzER. 

As in the case of addition one may show that | and multiplicative inverses are unique. The 
multiplicative inverse of a nonzero real number x is denoted x! or 1/x. We define x/y = x(y''!) ify F 
0. Any mathematical system satisfying axioms | to 11 1s called a field. Using axioms 1 to 11 one may 
establish all of the well-known algebraic properties of the real numbers. We give one example; others 
are given in the exercises. In subsequent sections we will assume that all of the well-known algebraic 
properties of the real numbers have been verified from the axioms. The interested reader may consult 
Landau (1960) to see how this might be accomplished. 


Theorem3.4 x-0=0 forall xinR. 
Proof. x:(0 + 0) = x:0 by axiom 4. On the other hand x:(0 + 0) =x-0 +x-0 by axiom 11. Thus x:0 = 
x-0 + x:0. Now 
x0 + [4x-0)] = (x0 + x-0) + [-(x-0)] 
Again using axiom 5 and axiom 2, we have 
0=x0+0 
and so by axiom 4 we have 0 =x: 0. 


Exercises 


3.1 Prove that the additive inverse of axiom 5 is unique. 

3.2 Prove that 
(a) (x+y)+(z+w)=(x+(v +z))+w forallx,yz,wER 
(b) The sumx + y +z + wis independent of the manner in which the parentheses are 
inserted. 


3.3. Prove that —(—x) =x for allx € R. 

3.4 Prove that -(x + y)=-x-y forall x, vy ER. 

3.5 Letx, vy E R. Prove that xy = 0 ifand only ifx = 0 or y=0. 
3.6 Letx, vy ER. Prove that ifxy = xz and x #0, then y =z. 
3.7 Prove that —(xy) = x(—y) = (-*)y for all x, y E R. 

3.8 Prove that (-1)x = —x for allx € R. 


4. The Order Axiom of the Real Numbers 


In this section we give the order axiom of the real numbers and derive several useful results. 


Axiom 12. There is a subset P of R called the positive real numbers satisfying 
(i) Ifx andy are in P, thenx + y and xy are in P. 
(ii) Ifx isin R, exactly one of the following statements 1s true: 


x€P or x=0 or -—-x€P 


Using axiom 12 we can define the usual notation for order. 


Definition 4.1. Letx and y be real numbers. 
(i) x 1s negative if —x is positive. 
(11) x >y means x — y Is positive. 
(411) x>ymeansx >yorx =y. 
(iv) x<ymeans y > x. 
(v) x<y means y>x. 
The inequality x > y (x < y) is read “x is greater (less) than y” and the inequality x > y (x < y) is 
read “x is greater (less) than or equal to y.” Several order properties of the real numbers are given in 
the next theorem. 


Theorem 4.2 

(i) 1>0. 

Gi) Ifx>yandy>z, thenx >z,x,yzER. 
Gu) Ifx>y,thenx+z>y+z,x,yZER. 
(iv) Ifx>yandz>0, thenxz>yz,x,y,z ER. 
(v) Ifx>yandz<0, thenxz<yz,x,yzER. 


Proof. We prove parts (1) and (11) leaving the others as exercises. By axiom 12, exactly one of the 
following statements is true 


1€P or 1=0 or —-lEP 


By axiom 9, 1 # 0. Suppose — € P. Then by axiom 12, (—1)(—1) = 1 € P(see Exercise 3.8) and hence 
1 € Pand—1 € P which contradicts axiom 12. Therefore 1 € P and (1) holds. 


Ifx > y and y > z, thenx —y, y—z € P by Definition 4.1. By axiom 12, x-—z=(x-y)+(y-z) EP 
and thus x > z. g 


We will employ the following notation throughout the remainder of the text. 


Definition 4.3 Leta, b € R witha < b. We define 


(a,b) = {xe R|a<x < 5} 

[a,b] = {xeR[a <x < 8} 

{a, 6) = {xe R|as x <b} 

(a, b] = {xe R|a <x < B} 
(—w, a) = {xER|x < a} 
(—o, a] = {xeER|x < a} 

[a, oo) = {xe R|a < x} 

(a, 00) = {xER|a < x} 
(—7%, 0) =R 


We call (c, d) an open interval; [c, d| a closed interval; and either [c, d) or (c, d] a half-open 
interval, where c or d are possibly + ©. 

We conclude this section by defining the absolute value of a real number and deriving several 
results concerning absolute value. 


Definition 4.4 Letx be areal number. We define 


We call |x| the absolute value of x. 


Theorem 4.5 

(i) Lete>0. Thenjx|<e ifand only if-e <x <¢and|x|<e ifand only if—¢<x <e. 
(ii) x <jxyforallx ER. 

Gil) jxyypqrypxqpyyforallx,y ER. 

(iv) jxtyysjxjtyyyjforallx,y ER. 


Proof. We prove only (11) and (iv) leaving the others as exercises. 

Ifx = 0, thenx =|xj<jxq. Ifx <0, thenx =—jx)<,x]. Ineither case x <jx]. 

Ifx +y>=0, thenjx +yp=xt+y<jxyt+yyyby (i). Ifx +y <0, thenjx +yj=-(x+y)=-x-ys 
[xy + yyy by Gi). m 


Exercises 


4.1 Prove parts (111), (iv), and (v) of Theorem 4.2. 
4.2 Prove parts (1) and (111) of Theorem 4.5. 
4.3 Prove thatifx <y and y <x, thenx=y,x,yER. 


4.4 Prove that if xy > 0, then either x > 0 and y>0 orx<Oandy<0,x,yER. 
4.5 Prove thatifx > 0, then 1/x >,x € R. 

4.6 Prove that x’ > 0 for all x € R withx 40. 

4.7 Prove that x? +” > 2xy for allx, y E R. 

4.8 Prove that if 0 < xy and x < y, then I/y < I/x,x,y ER. 

4.9 Prove thatifx <y +e for everye > 0, thenx<y,x,yER. 

4.10 Prove thatifx+y>zandw>vx,thnw+y>z,x,y2z,wER. 


5. The Least-Upper-Bound Axiom 


Before giving the final axiom for the real numbers we must make some definitions. 


Definition 5.1 A nonempty subset _X of R is said to be bounded above (below) if there exists a real 
number a such that x <a (x >a) for all x € X. The number a is called an upper (lower) bound for X. 


Definition 5.2 Let_X be a nonempty subset of R. 
A number a in R is said to be a east upper bound for X if 
(1) ais anupper bound for X. 
(ii) Ifbis anupper bound for_X, then a <b. 
A number a in R 1s said to be a greatest lower bound for X if 
(1) ais a lower bound for_X. 
(ii) Ifbis a lower bound for X, then b <a. 
Part (11) of Definition 5.2 concerning least upper bounds may be equivalently stated as follows: if b 
<a, then 6 is not an upper bound for X. By Definition 5.1, this last statement is equivalent to 
(11’) If b < a, there exists x € X such that b < x. 
In proving that a is a least upper bound for a set_X, it is sometimes easier to use (11’) rather than (11). 
Part (11) of Definition 5.2 concerning greatest lower bounds may be rephrased ina similar way. 
The next theorem states that if.a set has a least upper bound, it is unique. 


Theorem5.3 Let X be a subset of R. If a and 5 are least upper bounds for_X, then a = b. 


Proof. By Definition 5.2, since a is a least upper bound for X and 5 is an upper bound for _X, we 
have a <b. Similarly, b <a, and thus a = b. g 

Theorem 5.3 (and the corresponding result for greatest lower bounds) allows us to speak of the 
least upper bound (or the greatest lower bound) and justifies the following notation. If a is the least 
upper bound of a set_X, we let a = lub_X. Similarly, if 5 is the greatest lower bound of a set_X, we let 
b= glb X. If X 1s finite set, we also denote lub XY by max_X, and we denote glb XY by mn_X. 

For example, 


lub(0, 1) = 1 = lub[0,1] 
and glb(0, 1) = 0 = glb[0,1] 


The least upper bound of a set_X is also called the supremum of X, and the greatest lower bound of a 
set X is also called the infimum of X. The notation lub_X = sup X and glb X = inf X is also used. 


Axiom 13. A nonempty subset of real numbers which is bounded above has a least upper bound. 


Figure 5.1 


Axiom 13 1s called the completeness axiom for the real numbers. The real numbers are complete in 
the sense that there are no “holes” in the real line. Informally, if there were a hole in the real line (see 
Figure 5.1), the set of numbers to the left of the hole would have no least upper bound. 

The least-upper-bound axiom is the basis of many deep theorems in analysis concerning the real 
numbers. Many theorems about the real numbers (for example, Theorems 16.2 and 18.1) which 
involve the existence of a number with special properties ultimately rest on this axiom. 

Using axiom 13, we are able to prove the existence of greatest lower bounds. 


Theorem 5.4 A nonempty subset of real numbers which is bounded below has a greatest lower 
bound. 


Proof. Let X be a nonempty subset of real numbers which is bounded below, and let Y be the set 
of lower bounds for X. Let c € X. Then y <c for y € Y. Thus Y is bounded above, and by the least- 
upper-bound axiom Y has a least upper bound a. We will show that a is the greatest lower bound of X. 

Let x € X. Then y <x for all y € Y, and thus x is an upper bound for Y. Since a is the least upper 
bound of Y, we have a <x. Therefore, a is a lower bound for_X. 

Let b any lower bound for X. Then b € Y, and hence 6b < a. By Definition 5.2, a is the greatest 
lower bound of X. g 


Exercises 


5.1 Let X be a set of real numbers with least upper bound a. Prove that if ¢ > 0, there exists x € X 
such that a — ¢ <x <a. 

5.2 Prove that the greatest lower bound of a set of real numbers 1s unique. 

5.3. Give another proof of Theorem 5.4 by considering the least upper bound of the set 


“X= {-x|x € X} 
5.4 Show that if_X is a nonempty subset of real numbers which is bounded above then 
lub _X = —glb(—X) 


5.5 Let X and Ybe nonempty subsets of real numbers such that Y C Yand Yis bounded above. 
Prove that 


lub X < lub Y 


5.6 Let X be a set of real numbers with least upper bound a. Let t > 0. Prove that ta is the least 


upper bound of the set 
tX = {ix|x € X} 


State and prove an analogous result if t < 0. 


5.7 Let X and Ybe sets of real numbers with least upper bounds a and 5, respectively. Prove that a 
+ 6 is the least upper bound of the set 


X+V= ix tylxEX ye VY} 


5.8° Iffis a real-valued function on (a, b) and c € (a, b), we say that fis strictly increasing at c if 
there exists 0 > 0 such that ifc — 6 <x <c, then f(x) </f(c) and ifc<x<c +o, then /f(c) < 
Six). We say that fis strictly increasing on (a, b) if whenever x, y € (a, b) withx < y, we 
have f(x) < f(y). Prove that if fis strictly increasing at each point of (a, b), then fis strictly 
increasing on (a, b). 


6. The Set of Positive Integers 


We now isolate that subset of the real numbers known as the positive integers. We will define the 
positive integers as the smallest subset P of R having the properties that 1 € P and ifn € P, thenn + 
LeP, 


Definition 6.1 A subset_X of R is said to be a successor set 
(i) If 1 €.X, 
(11) Ifnm € X, thenn +1 € YX. 

Since R itself is a successor set, successor sets exist. 


Lemma 6.2 If is any nonempty collection of successor sets, then Mg 1s a successor set. 


Proof. Since 1 € A foreveryA€ wv, lEN w@. 
Suppose n € fg. Then n € A for every A € yg. Since every set A in ¢ 1S a successor set,n +1 € 
A for every A € gy, and thusn+/ €Oyg._ 


Definition 6.3 The set P of positive integers is the intersection of the family of all successor sets. 


By Lemma 6.2, P is a successor set. P is the smallest successor set in the following sense: if X is a 
successor set, P C_X. This is important but fairly 
easy to see. Letx € P. Then x belongs to every successor set, and in particular, x belongs to_X. 

The theorem of mathematical induction follows almost immediately from Definition 6.3. 


Theorem 6.4 (Mathematical Induction) Suppose that for each positive integer n, we have a 
statement S(n). Suppose also that 

(i) S(1) 1s true. 

(11) IfS(7) is true, then S(7 + 1) is true. 


Then S(7) is true for every positive integer n. 


Proof. Let G={n € Pj S(n) is true}. Then G C P. On the other hand, 1 € G, and ifn € G, thenn 
+ 1 € Gby (11). Thus Gis a successor set, and so P C G. Therefore G= P. g 


As an example of a proof by induction we will establish the following theorem. 


Theorem6.5 If7 1s a positive integer, then n > 1. 


Proof. Let S(n) be the statement “n > 1.” Since 1 > 1, S(1) is true. Ifn > 1, thenn+1>n>1;s0 
if S(n) is true, then S(n + 1) is true. Therefore S(7) is true for every positive integer n by Theorem 
6.4. 9 


Theorem6.6 Ifmn€ P,thenm+n€ P. 


Proof. Let S(m) be the statement “m +n € P for all n € P.” The term 1 +7 € P for alln € P 
since P is a successor set, and so S(1) is true. Next assume m + n € P for all € P. Then(m+1)+n 
=(m+n)+1 € P for all n € P since P is a successor set (m + n € P implies (m + n) + 1 € P). 
Thus if S(m) is true, then S(m + 1) is true; so by Theorem 6.4, S(m) is true for all m € P. g 

The next theorem we will prove is the well-ordering theorem for the positive integers (Theorem 
6.10). The proof of this theorem depends on the fact that ifn is a positive integer, there is no positive 
integer between n and n + | (Lemma 6.9), and in order to prove this result we must establish two 
lemmas. 


Lemma 6.7 Ifn € P, theneithern-—1=Oorn—J/€P. 
Proof. Let 


G=i{n€ Pijn-1=O0o0rn-1€ PRP}. 


We show that G is a successor set. Clearly 1 € G. Suppose 1 € G. Then(n + 1)—-1=n€ P;son+1 
€ G. Therefore G = P. (Why?) g 


Lemma 6.8 Ifm,n € Pandm <n, thenn-m € P. 


Proof. We proceed by induction on m letting S(m) be the statement of the lemma. 

Suppose | <n,n € P. By Lemma 6.7, either n -1=0Oorn-—1 € P. Sincen#1,n—-1€ P. 

Assume that ifm, n € P and m <n, thenn —m € P. Suppose m+ 1 <n, m, n € P. By Lemma 6.7 
and Theorem 6.5, n — € P. Since m < n — 1, by induction we see that (n — 1) — m € P. Thus n -(m + 
1) € P, and we have completed the inductive step. g 


Lemma 6.9 _ Letn be a positive integer. No positive integer m satisfies the inequalityn <m<n+t1. 


Proof. Suppose there exists m € P such that n < m<n+ 1. By Lemma 6.8, m — n € P. On the 
other hand, since m <n+1, we have m — n< 1, which contradicts Theorem 6.5. g 


We are now ready to prove the well-ordering theorem. 


Theorem 6.10 (Well-Ordering Theorem) _ If_X is a nonvoid subset of the positive integers, then _X 
contains a least element; that 1s, there exists a € X such that a <x for all x € X. 


Proof. We use induction on n, letting S(7) be the statement: “If € X, then _X contains a least 
element.” 

If 1 €_X, then 1 is the least element of X by Theorem 6.5. 

Now assume S(7) is true and suppose n + 1 € X. Since S(n) is true, X U {n} contains a least 
element m. Ifm €_X, then m is the least element of X. If m ¢X, thenm =n and n <x for allx € X. 
Since n ¢.X, we have n + 1 <x for all x € X by Lemma 6.9. In this case n + 1 is the least element of 
X. 


Theorem 6.11 The set of positive integers is not bounded above. 


Proof. If P is bounded above, then by the least-upper-bound axiom, P has a least upper bound a. 
Since a — 1 is not an upper bound for P, there exists n € P such that a — 1 <n. But thena <n +1, 
which contradicts the assumption that a is an upper bound for P. g 


Corollary 6.12 The set of real numbers is Archimedean ordered; that is, if a and b are positive real 
numbers, there exists a positive integer n such that a < nb. 


Proof. Since P is not bounded above, there exists n € P such that a/b <n. Thusa<nb.g 


Corollary 6.13 If é1is a positive real number, there exists a positive integer N such that 1/N < e. 
Proof. Take a=1,b =e inCorollary 6.12. g 
Exercises 


6.1 Prove the formula 1 +2+3+---+n=n(n + 1)/2. 

6.2 Prove that if m and n are positive integers, then m-n is a positive integer. 

6.3. Prove the binomial theorem: If a and b are real numbers and 7 1s a positive integer, then 
or (ee (hemes (erro (8 art 
where (7) a” or 

6.4 Prove that if X is a nonempty subset of positive integers which is bounded above, then XY 
contains a greatest element. 

6.5 Where is the flaw in the following “proof” by induction that any two positive integers are 
equal? 
Theorem Let & and m be positive integers. If is the maximum of k and m, thenn = k =m. 
Proof. Let S(n) be the statement of the theorem. If 1 = max {k, m}, thenk = m= 1 by 
Theorem 6.5. Suppose n + 1 = max {k, m}. Then n = max {k- 1, m-— 1} so by inductionn = k 
—l=m-—l,andthusn+1=k=myg 

6.6 Prove the second form of mathematical induction: Suppose that for each positive integer n, we 
have a statement S(n). Suppose also that 


(a) S(1) is true. 
(b) If S(K) is true for all & <n, then S(n) 1s true. 
Then S(7) is true for all positive integers n. 

6.7 Deduce Theorem 6.4 from Theorem 6.10. 

6.8 Deduce Lemma 6.9 from Theorem 6.10. 


7. Integers, Rationals, and Exponents 


In this section we will define the integers, rational numbers, and rational exponents and collect some 
miscellaneous results. 


Definition 7.1 The set of integers, denoted Z, is the set 
{0} UPu—P 


where —P = {-n € P}. 
It can be shown that Z is a commutative group (that is, Z satisfies axioms | to 5). We may define 
the rational numbers in terms of the integers. 


Definition 7.2 The set of rational numbers, denoted Q, is the set 


lagez and q #0} 


It can be shown that Q is a field (that is, Q satisfies axioms | to 11). However we will shortly 
prove that QR. 
It is convenient at this point to define x”, where x € R and n € z. 


Definition 7.3. Letx € R. We define 


Ifx 4 0, we define 


x=1 and x"= =. neP 

From this definition one can deduce the laws of integer exponents (see Exercise 7.5). 

We next show that there is no rational number x such that x? = 2 (Theorem 7.4), but there is a real 
number x such that x* = 2 (Theorem 7.5). These results show that Q is a proper subset of R. The fact 
that 3 is not rational is one reason for extending Q to the larger set R. A real number which is not 


rational is said to be irrational. 


Theorem 7.4 There is no rational number r satisfying 7? = 2. 


Proof. Suppose there exists r € OQ satisfying r* = 2. Then r = p/q where p, g € Z and g # 0. We 
may assume that not both p and g are even. Then p* = 2g’. This implies that p’, and hence also p is 
even. Thus p = 2n for some n € Z. Now 4n?* = 2q’; so 2n* = gq’, and hence g is also even. This 
contradiction establishes the theorem. g 


We now prove the existence of nth roots in the set of real numbers. The idea of the proof is that the 
nth root of a should be the largest real number b such that b” < a. The least-upper-bound axiom will 
guarantee the existence of such a number. 


Theorem 7.5 _ If a is a nonnegative real number and 7 is a positive integer, there exists a real 
number 5 > 0 such that b” = a. 


Proof. Let 
X = {xe R|x = 0 and x" < a} 


X is nonempty since 0 € X. 
We argue by contradiction to show that X is bounded above by a + 1. Suppose there exists x € X 
such that x > a+ 1. Then 


a>xX">(@+lJ"= ¥ (ja = na 
k=0 


which is impossible; so X is bounded above. By the least-upper-bound axiom, X has a least upper 
bound b. We will prove that 6” = a. Either b" < a, b" > a, or b” = a. We show that the first two 
possibilities cannot occur. 


Suppose b” < a, and let d = a — b". Choose positive integers m,,..., m,_, such that 
ny, fr) = 7 
(i) mF < => ie eA) T. ,a—l 
Let m= max {m,...,m,_,}. Then 


k=O 
m-i § 
< —~ + 5° 
pe 
x#O+0=a4 


Therefore b + 1/m €_X, but b < b + 1/m which is impossible; thus a < b". Similarly, one shows that a 
<b" is false, and therefore a = b". g 


It can be shown that the number 5 in Theorem 7.5 is unique (Exercise 7.8). 


Corollary 7.6 If ais areal number and n is an odd positive integer, there exists a real number b 
such that b” = a. 


Proof. By Theorem 7.5, there exists a real number c such that c” =; a). Ifa= 0, c" =a, and we 
have the desired conclusion. If a < 0, let b = —c. Then b” = —c" = a, and again we have the 
conclusion. g 


We are now in a position to define x”, where x is real and r is rational. We will conclude our 
definitions of exponents in Section 17 when we define x’, where x and y are real numbers and x > 0. 


Definition 7.7 Let x be a nonnegative real number, and let n be a positive integer. We define x'” 
to be the nonnegative real number y such that y” = x. 


If x is a real number and n is an odd positive integer, we define x!” to be the real number y such 
that y" = x. 
Ifx is a real number and 7 1s a positive integer, we define 


1 


—i/n 
x = 
x 


provided x” # 0 and x!” is defined. 
If x is a real number and , is a rational number, r = p/qg, where p, g € z and r is expressed in 
lowest terms, we define 


x = (x12 


whenever x"4 is defined. 

From this definition one can deduce the laws of rational exponents (see Exercise 7.6). 

We close this chapter with two theorems which show that there are many rational and irrational 
numbers. The proof of the first theorem is illustrated in Figure 7.1. 

Theorem 7.8 Ifa and b are real numbers with a < b, there exists a rational number r such that a 
<7 0, 


Proof. First we consider the case that b > 0. Choose a positive integer such that b — a > 1/n. Let 
m be the least positive integer such that b < m/n. Ifm = 1, clearly (m— 1)/n < b. Ifm>1,m- lisa 
positive integer less than m, and thus (m — 1)/n < b. 

Since a — b <— 1/n and b <m/n, we have 


m— 1 


1 
a ee 
non a 


Thus the rational number r = (m — 1)/n satisfies a < r < b. We have established the theorem in case b 
> 0. 

Suppose now that a and b are arbitrary real numbers with a < b. Choose a positive integer n such 
that b +n > 0. By the special case just established, there exists a rational number 7’ such that a + n < 
r'<b+n. Thus r =r'— nis a rational number satisfyinga<r<b.g 


Figure 7.1 


Lemma 7.9 The sum ofa rational number and an irrational number is an irrational number. 


Proof. Suppose the lemma is false. Then there exists a rational number r and an irrational number 
s such that t =r +s is arational number. Then s = t — ris the difference of two rational numbers and 
is therefore rational. This is a contradiction. g 


Theorem 7.10 Ifa and b are real numbers with a < b, then there is an irrational number s such that 
as <p, 


Proof. By Theorem 7.8, there exists a rational number 7, such that a —- ya <r, <b-— yz. By 
Theorem 7.4 and Lemma 7.9, r =r, + 3 1S an irrational number. Since a < r < b we have completed 
the proof. g 


In Chapter III we will give a very different proof of Theorem 7.10. 
Exercises 


7.1 Prove that Z is a commutative group. 
7.2 Prove that Q is a field. 
7.3 Prove that there is no rational number r satisfying 7? = 3. 
7.4 Prove that there is no rational number r satisfying 7° = 2. 
7.5 Prove the laws of integer exponents: 

(a) mre — yet ve R, x #0, mneZ 

(b) vad, xeR, x #0, nEZ 


(C) (xy = x"y", x,peR, x #04 y,neEZ 
(d) (x™)" = x™", xER, x #0, mneZ 
(e) (2)" = 5B yER, x AOA y,neEZ 
(f) If0<x<y, thenx*<y,n€ P 
(g) Ifn<mandx>1, thenx*®<x™,n, m € Z. 
7.6 (a) Do Exercise 7.5 with x and y positive and m and n rational numbers. 
(b) Discuss Exercise 7.5, where x and y are arbitrary real numbers and m and 7 are rational 
numbers. 
7.7 Complete the proof of Theorem 7.5 by showing that b” > a is impossible. 
7.8 Prove that if a >0 and n is a positive integer there exists a unique b > 0 such that b” = a. 
7.9° Prove that the set of real numbers as defined by axioms | to 13 is unique in the following 
sense: If R’ is a set which satisfies axioms | to 13, there exists a one-to-one function f from R 
onto R’ which satisfies 


fxt+y=fax) +s) forall x,yeER 
f(xy) =f) forall x,yeR 
f(x) <fQ) ifand only ifx<y for x,yeR 
7.10 Prove that no equilateral triangle in the plane can have all vertices with rational coordinates. 


“The asterisk indicates that the entry is discussed in the Hints to Selected Exercises at the back of the book. 


Set Equivalence 


When do two (possibly infinite) sets have the same number of elements? In this chapter we will give 
a definition (Definition 8.1) which answers this question. We will show that according to our 
definition there are as many positive integers as there are rational numbers, but that there are more 
real numbers than positive integers. 


8. Definitions and Examples 
Suppose we are given two finite sets XY and Y and are asked to compare their sizes. One way to do 


this is to count the number of elements in each set and compare the results. An alternative method is to 
pair off the elements 1n_X with those in Y. 


X = {a, b,c, d} 
Ets 
Y = {1, 2, 3, 4} 


This second method generalizes to infinite sets, and thus we make the following definition. 


Definition 8.1 Let XY and Y be nonempty sets. We say that X 1s equivalent to Y and write X =~ Y if there 
exists a one-to-one function from_X onto Y. 

Obviously X = X. (Why?) If X = Y, then Y = X. (Why?) The relation = is also transitive. If X = Y 
and Y = Z, then X ~ Z. (Why?) 


Sets are divided into two categories as specified in the following definition. 


Definition 8.2 A set X is finite if either X= g or X = {1, 2,...,} for some positive integer n. A set 
which is not finite is said to be infinite. A set X is countable if either X is finite or X ~ P. A set X is 
uncountable if X is not countable. 

If a set X is countable and infinite there is a one-to-one function f from P onto X. Thus the elements 
of X may be listed 


KI), A2), 43); 


or aS we sometimes write 


A, f, fp, 


The set of even positive integers is countable, since the function f defined by f(1) = 2n is a one-to- 
one function from P onto {2, 4, 6, ...}. The correspondence or listing is 


— + 
NnN<- 
Wo ee ON 
th <> CO 


The set of all integers is countable since the function f defined by 


_ i I 


5} if nis odd 


fi) = 
5 if n is even 


is a one-to-one function from P onto Z. The correspondence or listing is 


O01 -1 2 - 
{ft ff 7 
ia wat & 


To prove that a set X is countable from the definition, one must exhibit a listing like those given 
above (a one-to-one function from P onto _X). In view of the remarks preceding Definition 8.2, one 
may also show that a set X is countable by showing that _X is equivalent to a set which is known to be 
countable. To prove that a set_X is uncountable, one would have to show that there is no one-to-one 
function from P onto _X. The usual method is to assume the existence of such a function and deduce a 
contradiction. A remarkable fact is that uncountable sets exist. We will see later that the real numbers 
are uncountable. At this point we will give a different example of an uncountable set. 


Example 8.3 A real sequence is a function from P into R. In this example we will denote a real 
sequence as 


(4, @,..-) a,€R,n = 1, 2,. 


X = {{a,, a,,...) (4, € {0, 1},2 = 1,2,...} 


Thus X is the set of all real sequences which assume only the values 0 or 1. We show that _X is 
uncountable. If X is countable, the elements of XY may be listed: 


1 1 
le (ai, ay , a§ # e- ) 


2) (2) (2 
2 (a, a, a, . ..) 


We will now define a sequence which is not in the list, thus deducing a contradiction. Let 


p if a” = 1 


1 if a =0,n=1,2,... 


Then (6,, b,, . . .) is a sequence in X which is not in the list, and hence_X is uncountable. 


If X is a set, we let P(X) denote the collection of all subsets of X. [PCX) is called the power set of 
X.] 


Theorem 8.4 Let_X be a set. Then XY x P(X). 


Proof. If X = @, then P(X) = {@}; so X # P(X). Therefore, suppose X 4 g@ and _X = P(X). Then there 
exists a one-to-one function f from XY onto P(X). We now define a subset Y of X which is not in the 
range of f thus deducing a contradiction. Let 


Y= {xeX|x€f(x)} 


If ye f(x), there exists ye x such that f(y) = Y. Either ye y or y¢ Y , and we examine the two 
possibilities. 
1. Ifpe y, then y¢ f(y). Thus y ¢ fry) = y. The first case is impossible. 
2. If y¢ y, then » f(y). Thus » e f(y) = y. The second case is impossible. 
Thus y ¢ f(x), and we have the desired contradiction. 


Corollary 8.5 P(P) is uncountable. 


Exercises 


8.1 Prove that the set of even integers 1s countable. 

8.2 Suppose that_XY and Y are equivalent sets. Prove that P(X) = P(Y). 

8.3 Prove that every infinite set has a countably infinite subset. 

8.4° Prove that a set_X is infinite if and only if_X is equivalent to a proper subset of itself. 

8.5 Let X be a set. Let S be the set of all functions from_X into {0, 1}. (Such functions are called 
characteristic functions.) Prove that S x P(X). How does this exercise connect Example 8.3 
and Corollary 8.5? 


9. Countable and Uncountable Sets 


The following result should not be too surprising. 


Theorem 9.1 Any subset of the positive integers is countable. 


Proof. Let X be a subset of P. If X is finite, there is nothing to prove; so assume X is infinite. We 
define a function f from P to X as follows: Let f(1) be the least element in X. Let f(2) be the least 
element of X\{/(1)}. Continuing in this way, having defined f(1), f(2),...,/(7), we let f(n + 1) be the 
least element of X\{f(1), f(2), ...,f(n)}. It is easy to verify that fis a one-to-one function from P onto 
X, and therefore X is countable. gy 


Corollary 9.2 Any subset of a countable set is countable. 
The next theorem shows that the one to one requirement need not be checked in proving that a set is 
countable. 


Theorem 9.3 Let_X be a nonempty set, then X is countable if and only if there exists a function f from 
P onto X. 


Proof. If X is countable and infinite, there is nothing to prove. If_X is finite, then Y= {1,2,...,n} 
for some ye Pp; SOX = {x,,x5,...,X,}. Define fi) =x, fori=1,2,...,n and fj) =x, for all j > n. 
Then fis a function from P onto_X. 

Suppose fis a function from P onto a set_X. If X is finite, there is nothing to prove; so assume_X is 
infinite. We define a function g from_X onto a subset of P by the rule 


g(x) = min{f~'(x)}, ‘for each xe X¥ 


Then g is a one-to-one (check this) function from_X onto g(X). g(X) 1s an infinite subset of P; hence by 
Theorem 9.1, g(X) is countable. Thus XY = g(X) =~ P and X is countable. ™ 
Suppose 4,, 4,,... are countably infinite sets. We may list the elements of A, as 
af”, aS, af, 


We now find that we may list the elements of | 2. , A, 


Ard) aa... 
ne ns 
qi?) a a? ree 
7: 
a a 2 
A 
The arrows indicate that 
i a 
2 — af}? 
33 a? 


We have described a function from P onto ()2., 4,; so by Theorem 9.3, |)#., 4, is countable. This 


n= 
result is often summarized by saying that a countable union of countable sets is countable. We will 
now give another (tricky) proof of this theorem. 


Lemma 9.4 The set P x P is countable. 


Proof. The function f: P x P — P defined by 


f(n,m) = 273" 


is one to one, since factorization into primes is unique. Thus P x P is equivalent to a subset of P. By 
Theorem 9.1, Px P is countable. m 


Theorem 9.5 Let 4,, 4,, . .. be a countable family of countable sets. Then 
U 4s 
n=] 

is a countable set. 


Proof. Since A, is countable, we may list the elements of 4, 


A,: ay", af, a’, 


(In case A, is finite, 4, = {a,..., a}, we let a = g@ ifi zm. IfA, = @, redefine A, = A,, for some 
A, #@- Ifall 4, = @ then|)*_, 4, = g@ 1s countable.) 
The function f defined by 


f{n,m) = a,” 


maps P x P onto | )*., 4, By Lemma 9.4, P = P x P, and it follows that we may map P onto | )#., 4,. By 


aml he | 


Theorem | )2., 4, 1S countable. 
Corollary 9.6 If A and B are countable sets, then 4 | g 1s a countable set. 


Corollary 9.7 The set Q of rational numbers is countable. 


Proof. For each positive integer n, let 
ee ert 


Then 4, is countable for each positive integer n. (Why?) By Theorem 9.5, Q= )#., 4,18 countable. m™ 


nmi 
Theorem 9.8 Any interval of R is uncountable; in particular, R is uncountable. 


Proof. Let J be an interval of R, and suppose / is countable. Then the elements of J may be listed 


Choose a,b, ¢ R Such that r, ¢ (a,, 6,) c J. Choose @,,b,¢ R Such that a, < a, < b, < b, and r, ¢ (a, 65). 
Continue in this way so that having chosen g,,5, ¢R, we choose a,,.,,b,., €R Such that a, <a,,, < b,., < 
b, and Pel ¢ (4,41 Bas 1): 


The set {a,, a, ...} is bounded above by b; so the least upper bound r of this set exists. It follows 
that a, <r for all » <p. On the other hand, 7 < 5, for all »ep for if b, <r for some me P, we would 
have 


a, 26,4, S59 


for all yep. Thus 5,,, would be an upper bound for {a,, a,, . . .}, but since b,,, < 7, this is 
impossible. Therefore ye(a,,6,) for all »ep. It follows that r zr, for every yep and rey. This 
contradiction establishes the theorem. m 


Corollary 9.9 Irrational numbers exist. 


Proof. If every real number were rational, R would be countable by Corollary 9.7. This statement 
contradicts Theorem 9.8. my 


The proof of Corollary 9.9 caused considerable consternation when first given by Cantor, for it 
proves the existence of irrational numbers without exhibiting a sing/e irrational number! 


Corollary 9.10 The set of irrational numbers is uncountable. 


Proof. Suppose Q’ is countable. By Corollary 9.7, Q is countable; so by Corollary 9.6, R = QUQ’ 
is countable. This contradicts Theorem 9.8. gy 
We are now ina position to give another proof of Theorem 7.10. 


Theorem 9.11 (Revisited) If a and 5 are real numbers with a < 5, then there is an irrational number s 
such that a < s < b. 


Proof. If (a,b) < Q, then by Corollaries 9.7 and 9.2, (a, b) is countable, and this contradicts 
Theorem 9.8. gy 


Exercises 


9.1. Prove Corollary 9.2 (give all the details). 

9.2 Whenis the function described before Lemma 9.4 one to one? 

9.3. Let A and B be sets. Prove that if A is countable and B is uncountable, then 4 vu gis 
uncountable. 

9.4 Let A and B be sets such that 4 « g.. Prove that if A is uncountable, then B is uncountable. 

9.5 Deduce the fact that P x P is countable from Theorem 9.5. 

9.6 Prove that if A and B are countable sets, then A x B is countable. 

9.7° Prove that the set of all polynomials of degree n with rational coefficients is countable. 

9.8° Prove that the set of all polynomials with rational coefficients is countable. 

9.9 Areal number r is said to be algebraic ifr is a root of a polynomial with rational 
coefficients. If7 is not algebraic, r is said to be transcendental. (It is known that e and m are 
transcendental.) 

(a) Prove that every rational number and every root of a positive rational number are 


algebraic numbers. 
(b) Prove that r is an algebraic number if and only if 7 is a root of a polynomial with integer 
coefficients. 
(c)° Prove that the set of algebraic numbers is countable. Deduce that transcendental numbers 
exist. 
9.10° Prove that the plane is not the union of a countable family of straight lines. 
9.11 Prove that the collection of finite subsets of P is countable. Deduce that the collection of 
infinite subsets of P is uncountable. 


IV 


Sequences of Real Numbers 


Analysis is concerned in one form or another with limits. We begin our study of real analysis with the 
study of limits of real sequences. 


10. Limit of a Sequence 


Let X be a set. A sequence of elements of X is a “list” of elements from the set X. In this chapter we 
will be concerned with sequences of real numbers. We first make the notion of sequence precise. 


Definition 10.1 Let X be a set. A sequence of elements of X is a function from the set of positive 
integers into X. 

In particular, a real sequence (or sequence of real numbers) is a function from P into R. The usual 
notation for a real sequence is {a,}*_,, where a denotes the function from P into R and a, is the value 
of the function at the positive integer n. The notations a,, a,,...and {a,} are also used to denote a 
real sequence. The number a, is called the nth term of the sequence {a,}%_ ,. 

A sequence may be defined by giving an explicit formula for the nth term. For example, the formula 


defines the sequence whose value at the positive integer n is 1/n. The first three terms of this 
sequence are 


A sequence may also be defined inductively. Thus equations 


a, = Qn+1 
, 


@=0, a,=1, a4.= 2? Pe ee 


define the sequence whose first six terms are 
0, 1, 5, x 3; +4 


Consider the sequence {a,}“ , whose nth term is defined by the formula 


on 
el 


The first four terms of this sequence are 


which are close to 1. For example, 492 differs from 1 by only ;4,. It is clear that n/(n + 1) is “close 
to” 1 “for all large positive integers n.” For this reason we say that the sequence {n/(n + 1)}22., has 
limit 1. In general, we say that a sequence {g,}~., has limit L if a, is “close to” L “for all large 
positive integers n.” To define the limit of a sequence, we need to make the concepts “close to” and 
“for all large positive integers n” precise. 

Since ja,, — Lj is the distance between a, and L, we would agree that a, is “close to” L ifja, — Lj is 
small. How small? Given any positive number e (no matter how small) we wish to make ja, — Lj) < 
for all large positive integers n. If we can do this, we can make a, a, close to L as we wish simply by 
making ¢ small enough. “For all large positive integers n’” means “for all n greater than (or equal to) 
some fixed positive integer NV.” Thus the condition we are seeking is that if e > 0, there exists a 
positive integer N such that ja, — Lj < «, for all n = N. The positive integer N may depend on the 
which we are given. We would expect that as «is taken smaller, we would have to choose N larger. 


Definition 10.2 Let {a,;2., be a sequence of real numbers. We say that {a,}~, has /imit eR if for 
every e > 0, there exists a positive integer N, such that ifn > N, then 


la, - Ll <e 


Let us return to the sequence {n/(n + 1)}@.,, and prove that fn/(n + 1}, has limit 1. Ife > 0, we are 
required to show that for some positive integer NV 


ifn => N. Now 


1 
n+l 


n 
n+l 


and hence if we choose a positive integer N such that 1/(V + 1) <e, thenifn = N, 


and therefore {n/(n + 1)}., has limit 1. 
In exactly the same way, one can show that the sequencef1/n}z. ,, has limit 0. 
Since the inequality ja, — Lj < « in Definition 10.2 is equivalent to L — e<a,<L +s, we may 


restate Definition 10.2 as follows. The sequence {a,}~, has limit Z if for every « > 0, there exists a 
positive integer N such that if m = N, then a, is in the open interval (L — «, L + e). See Figure 10.1. 
Figure 10.1 provides a geometric interpretation of the statement “a, 1s close to L for all large positive 
integers n.”’ 

The next theorem allows us to speak of the limit of a sequence. The proof of this theorem is 


illustrated in Figure 10.2. 


Theorem 10.3 The limit of a sequence is unique. That is, if a sequence {a,}*, has limit Z and limit L’, 
then L = L’. 


Proof. We argue by contradiction. Suppose L x L.’ We assume that L < L’. (The argument is similar 
if L'<L.) Now e=(L'— L)/2 > 0; so there exists a positive integer NV, such that ifn > N,, then 


Ei ~ L 
2 


la, -— Ll < 


There exists a positive integer N, such that ifn > N,, then 


£ 


———— 
a4 L=€ anyg b ay L+te ap 
Figure 10.1 
L+L’ , 
L an — ay L 


s 
L+ee at = L’=e 


Figure 10.2 
Pe ae 

la, —L'| < 5 

If N= max {N,, N,}, then 
[2g an 
ay-Le< 5 and =a <a, -L’ 
and therefore 
ia oe 3 ae es 
ite dona 


which is impossible. gy 
If Z is the limit of a sequence {a,}, we write 


lim a, = L 


n~ ao 


which is read “the limit of a, as n approaches infinity is L.” 

Let {a,}2., be a sequence such that lim, _,.. a, = Z, and let e > 0. Then there exists a positive integer 
N such that if n = N, then ja, — Lj < e. The inequality ja, — Lj = « can hold for at most finitely many 
positive integers n (namely n = 1, 2,...,N-— 1). Thus a sequence {a,}~ , has limit Z if and only if for 
every e > 0, ja, — Lj = « for finitely many positive integers n. Therefore, a sequence {g,}~., does not 
have limit LZ if for some «> 0, ja, — Lj > e for infinitely many positive integers n. As an example, we 
prove that the sequence {g,}, does not have limit Z for any real number L. Let e= 1. Since — Lj> 1 
for infinitely many positive integers n, {¢,}~, does not converge to L for any real number L. 


Exercises 


In Exercises 10.1 to 10.8 prove the limit using Definition 10.2. 


10.1 timt=o 
10.3 tim +5 = 
104 te (~}) 
10.5 lim 5 73> 1 
10.6 lim = = 2 
10.7 tim cyr=0 


10.8 tim=0 


n+e 


10.9 Prove that the sequence ¢—1)"}z., has no limit. 

10.10 Prove that the sequence (( + (1/n))}#., has no limit. 

10.11 Let {a}, be a sequence with limit LZ. Suppose that ,4,}2., is a sequence such that for some 
positive integer V we have 


Dy = Qy for every n > N, 


Prove that lim 6, = £, 
10.12 Let {¢,}@., be a sequence such that lim, .. a, = L. Prove that 


lim |a,| = |Z] 
n+ 


10.13 What is wrong with the following “proof” of Theorem 10.3? Suppose the sequence {a,}*, 
has limits Z and L’. Then 


L = lima, and L’ = lima, 
Rew wo aw ® 


soL=lima,=L’ Of 
newo 


11. Subsequences 


Consider the sequence {a,}*, defined by a, = 1/n which begins 


If we were to cross out every other term our sequence would become 


l, 3, t, 4, 


The resulting sequence is called a subsequence of the original sequence. The first term of this 
subsequence is the first term of the original sequence; the second term of this subsequence 1s the third 
term of the original sequence; the third term of this subsequence is the fifth term of the original 
sequence; etc. Thus the subsequence is defined by 


eee err eeeereee 


ef e eee eee eee eee eee eee eae 


This subsequence is defined by composing the functions n — 2n — 1 and n — a,. We now define 
subsequences of arbitrary sequences. 


Definition 11.1 Let {a,;2., be a sequence. Let fbe a strictly increasing function from P into P. The 
Sequence {ay )}%., 18 called a subsequence of the sequence {a,}*.,. [The function f is strictly 
increasing 1f f(m) <f(n) whenever m < n.] 

In our example, the function f of Definition 11.1 is defined by f(n) = 2n — 1. The function f of 
Definition 11.1 specifies which terms of the original sequence we are to keep to form the 
subsequence. 

We now prove the “obvious” fact that if a sequence {a,}~., has limit Z, then any subsequence of 


{a,}2., also has limit L. 


Theorem 11.2 Let {a}. , be a sequence with limit L. Then any subsequence of {a,}~ , has limit L. 


Proof. Let {ap}, be a subsequence of {a,}~_,. Let e > 0. There exists a positive integer N such that 
ifn > N, then 


la, - Ll < ¢ 
Ifn = N, then f(n) = f(N) = N (verify), and therefore 
12 r¢ny — L| <€é 


Examples. The sequences {1/2"}#_, and {1/n!}%, are subsequences of {i/m!}, and lim, _,,. 1/n = 0, thus 


The sequence {(—1)"}*, has no limit because the subsequence (—1)32,, has limit 1 and the 
subsequence {(—})?"3=, has limit —1. 

We have used the notation {a,,,.}2, to denote a subsequence of a sequence {a,}~_,. The standard (and 
more confusing) notation for a subsequence of {a,}%., 1S {a,,}7,. Here, n denotes the function f, and k 
denotes an element of the domain P. 


Exercises 


In Exercises 11.1 to 11.4 a sequence 1s given and then a subsequence of the given sequence. Find a 
formula for the function f of Definition 11.1; give a formula for the sequence and a formula for the 


subsequence. 
11.1 1,2,3,4,... 
2A 0, 8 ire 
11.2 1,444 
2s Zs > Ios + 
11.3 1,2,3,4,5,. 
1, 3, 6, 10, 15, 
11.4 133843, 
LS. 


11.5 Let fbe as in Definition 11.1. Prove that f(1) =n for every ne P. 
11.6 Use Theorem 11.2 to prove the following limits. 


=0 


efBonn 
lim 732 = 0 lim 73 


11.7 Prove that the sequence {a,}~ , defined by 


‘ ={ if # is even 
*  \0 if n is odd 


has no limit. 
11.8 Let {a}, be a sequence. Suppose that 


lim a2, = L = lim G@on_1 
rn-~-&® nea 


Prove that lim a, = L.. 
11.9 Let {¢,}%., be a sequence which has a finite range. Prove that there is a subsequence of {a,}”, 
which has a limit. 
11.10 Let S, and S, be two subsequences of a sequence {a,}*_ ,. How would one distinguish S, and 
S, using the two notations for subsequences discussed at the end of this section? 
11.11 Prove that a subsequence of a subsequence is a subsequence. Discuss the notation for a 
subsequence of a subsequence. 


11.12 Prove that the set of subsequences of {1/n}s. , is uncountable. 


12. The Algebra of Limits 


Ifa sequence {a,} has a limit, we will say that {a,} converges. If {a,} has no limit, we will say that 
{a,} diverges. In this section we will show that sums, products, and quotients of convergent 
sequences are convergent. 


Theorem 12.1 Ifa, =Z for all ne p, then lim, a, =L. 
Proof. Lete> 0. IfN= 1, then 
la, - Ll) =0<e 
foralln>N. gy 
Theorem 12.2 Let {a,} and {b,} be sequences such that lim, _,.. a, = Z and lim, _,.. b, = M. Then 


n 


lim (a, + 5,)=L+M 


Proof. Let e> 0. There exists a positive integer N, such that if > N,, then 
Dany ae 5 
There exists a positive integer N, such that ifn > N,, then 
|b, —M| < 5 
Ifn > max {N,, N,}, then 


=6€ 


l(a, + 5,) — (ZL + M)| < la, — L + |b, - Mi< 545 


Theorem 12.2 states two facts about sums of convergent sequences. If {a,} and {b,} are convergent 
sequences, then the sequence {a, + b,} converges, and moreover, if {a,} and {5,} have limits Z and 
M, respectively, then {a, + b,} has limit Z + M. Analogous remarks apply to Theorems 12.3, 12.4, 
12.6, and 12.9. 


Example. In Section 11 we showed that 


By Theorem 12.2, 


Hitt oe ed 
n 


maa me 
Theorem 12.3 Let {a,} be a sequence such that lim, ,,. a, = L. Ifc is any real number, then 


lim ca, = cL 


n>2a 


Proof. If c = 0, the conclusion follows from Theorem 12.1, so assume c ¥ 0. Let e > 0. There exists 
a positive integer N such that if > N, then 


é 
coat | 


Ifn = N, then 


é 


=é 
le| 


|ca, ~~ cL| = ella, 4 | < |c| 


Corollary 12.4 Let {a,} and {b,} be sequences such that lim, a, = Z and lim,_,,, b, = VM. Then 


lim (a, — },) = L—M 


A-* oo 


Proof. By Theorems 12.2 and 12.3, 


lim (a, — 5,) = lim [a, + (—8,] = lim a, + lim (—1)6, 


aso ao 


=L+(-l)M=L-M a 


Before proving that the limit of a product is the product of the limits, we prove a lemma which is a 
special case. 


Lemma 12.5 Let {a,} and {b,} be sequences such that 


lim a, = 0 = lim, 


na ne 
Then lim,_,,, 4,5, = 9. 
Proof. Let e> 0. There exists a positive integer N, such that if > N,, then 
|a,| <1 
There exists a positive integer N, such that ifn > N,, then 
[,| < € 


Ifn > max {N,, N,}, then 


\a,5,| < é 


Theorem 12.6 Let {a,} and {b,} be sequences such that lim, .. a, = Z and lim, ,,. b, = M. Then 
lim... a,b, = LM. 


Proof. We write 
a,b, a (4, - L\b,, — M) = a,M 5 Lb, — LM 
By Theorem 12.1 and Corollary 12.4, 


lim (a, — L) = 0 = lim (6, — M) 
Lo) 


and using Lemma 12.5, we have 


lim (a, — L)(b, — M@) = 0 


By Theorem 12.3, 


lim a,éM = LM = lim Lb, 


n> co na 


By Theorem 12.2, 


lim a,b, = lim [(a, — Lb, — M) + a,M + Lb, — LM] 
n~ = nn @ 
= lim (a, — L)(b, — M) + lim a,M + lim Lb, + lim (—LM) 


=0+2M+LM-LM=LM | 


Corollary 12.7 Let {a,} be a sequence such that lim,_. a, = L, and let k be a positive integer. Then 
lim,.... & = L*. 


Proof. The proof follows from Theorem 12.6 by induction on k. 
As a preliminary to the quotient theorem for limits, we prove the following lemma. 


Lemma 12.8 Let {a,} be a sequence such that lim, .. a, =Z «0. Then a, x 0 for all but finitely many 
positive integers n, and 


Proof. If e =|Ly2, there exists a positive integer NV, such that ifn > N,, then 


[Z| 
a, -L< > 


Thus ifn > N,, 


L 
Ll < IL — al + lal < Et + fay 


[L 
and <lal @2™) 
Thus a, #0 ifn=N,. 
Let > 0. There exists a positive integer NV, such that ifn = N,, then 
[L|*e 


ja, - L| < —— 


Ifn > max {N,, N,}, then 


— 
= 


a,—L 
a,b 
— la, = L| 
fag ZI 
lZ/7e 2 1 


eg 
2 |L{ IL! 


Obviously the existence of the limit of a sequence and the value of the limit (if it exists) are not 
affected by altering or deleting finitely many elements of the sequence. Lemma 12.8 illustrates this 
situation in that we delete from the sequence {1/a,} those terms for which a, = 0. 


Theorem 12.9 Let {a,} and {b,} be sequences such that lim, ... a, = Z and lim, ,, b, =M «0. Then 


fim % = E 
aoe M 
Proof. By Lemma 12.8, 

1 1 
lim - = — 
n+o “an M 

y=, lt 1 £ 

ee a ale ae 


by Theorem 12.6. my 


Example. We use the preceding theorems to calculate 


ij 2n 
raed n+2 
lim 2 (Theorem 12.9) 
se ale ; aie 
lim —~; = lim 


wnt 2 yao l+ an. lim (i + Qn) 
naw 


lim 2 
———_- (Theorem 12.2) 
lim 1 + lim (2/n) 


now no 


lim 2 


~ jim I + 2 lim (ijn) (Theorem 12.3) 


2 
1 + 2-0 


=2 


Exercises 


In Exercises 12.1 to 12.4 compute the limit of the given sequence by using the theorems of Section 12 
as in the example at the end of Section 12. 


12.1 pw 4 
nee MT 2 
12.2 jim 2n?7 ++n+3 
neo «OF 1 
12. ey 
: lim nw+3 


12.4 lim yn F1— vn 
12.5 Give the details of the inductive proof of Corollary 12.7. 
12.6 Ifa,>0forn=1,2,...and lim... a, =L, prove that 


lim, Vf Qy = VL 


12.7. Iflim,_, (a,,,/a,) =, find lim,_.. a,. 


n+] 
13. Bounded Sequences 
We begin with a definition. 


Definition 13.1 We say that a sequence {a,} is bounded above (below) if there exists a number MV 
such that a, < M (a, = M) for every positive integer n. We say that {a,} 1s bounded if {a,} is bounded 
both above and below. 

It is easy to see that a sequence {a,} is bounded if and only if there exists a positive number M 
such that ja,|< M for every positive integer n. 

We next show that a convergent sequence is bounded. 


Theorem 13.2 If {a,} is a convergent sequence, then {a,} 1s bounded. 
Proof. Suppose lim,_,,, a, = L. Ife = 1, there exists a positive integer N such that ifn > N, then 
Preece | Bg 
Thus, if > N, we have 


la,| = la, — L| + |Z] < 1 +12] 


Ifn < N, then 


|a,| = max {|@,|, |@a|,.--, l@y—al} 
Thus for any positive integer n, 
|a,] < M 
if we let 
M = max {|q,|, |@2|,---» |@v—al, 1 + 121} 


It follows from Theorem 13.2, that the sequence {n}2_, diverges since the set of positive integers is 
not bounded. 

The sequence {(—1)"}*., 1s bounded and divergent and thus the converse of Theorem 13.2 does not 
hold. We will show later (Theorem 16.2) that a bounded monotone sequence is convergent. 

Our next theorem generalizes Lemma 12.5. 


Theorem 13.3 Let {a,} and {b,} be sequences such that {a,} is bounded and lim,_.. b, = 0. Then 
lim, ,,, 4,5, = 0. 


Proof. There exists a positive number M such that ja,|< M for every positive integer n. Let e > 0. 
There exists a positive integer N such that ifn = N, then 


\5,| < e/M 
Ifn > N, then 


ldyb,| < Maz =e 


Exercises 


13.1 Prove that if {a,} and {b,} are bounded sequences and c is a real number, then {ca,', {a, + 
b,}, and {a,b,} are bounded sequences. 
13.2 Let {a,} be a sequence with limit 0. Prove that 


lim (—1)" a, = 0 
n+ © 


13.3. Give an example of sequences {a,} and {b,} such that {a,} is bounded and {b,} is 
convergent, but {a, + b,} and {a,b } are divergent. 


non 


13.4 Leta, =1:3:5:- - (Qn—1)/[2:4-6: - - (2n)]. Prove that {a,} 1s a bounded sequence. 


14. Further Limit Theorems 


In this brief section we collect some miscellaneous theorems which are often useful in proving limits. 


Lemma 14.1 Let {a,} be a sequence such that 0 < a, for every positive integer n and L = lim, a,,. 


Then 0 < L. 


Proof. We argue by contradiction. Suppose L < 0. There exists a positive integer N such that if > 
N, then 


la -L< 


-L 
Thus ay — L=z— 


and therefore 


L 
ay<z <0 


which is a contradiction. gy 


Theorem 14.2 Let {a,} and {b,} be sequences such that lim, . a, = Z and lim, b, = M. Ifa, 
a, < b, < c, 5, for every positive integer n, then L < M. 


Proof. Since 0 < b, — a, for all ne Pp, we may use Theorems 12.4 and 14.1 to conclude that 0 < M — 
Lig 


A special case of Theorem 14.2 is often used with either {a,} or {b,} taken to be a constant 
sequence. For example, ifa, < M for all ze p and lim, ,,.a,=L, then <M. 


Theorem 14.3 (Squeeze Theorem) Let {a,', {b,}, and {c,} be sequences such that 


for every positive integer n. If 


lim a, = L = lim ¢, 


then in 6,=L 
Proof. Let e> 0. There exists a positive integer NV, such that if > N,, then 
L-e<a,<Lt+e 
There exists a positive integer N, such that ifn > N,, then 
L-—-e<c,<Lt+e 


Thus if > max {N,, N,}, we have 


L-s<a,55,5¢s5L+8 


Example. Since 0 < 1/2” < I/n and lim,_,,, 1/n = 0, by Theorem 14.3, lim, ,,, 1/2” = 0. 


Exercises 


14.1 Use the squeeze theorem to prove that lim, |, (1/n!) = 0. 

14.2. Whycan't Theorem 14.3 be deduced directly from Theorem 14.2? 

14.3 Prove the following theorem. Let {a,', {b,}, and {c,} be sequences such that for some 
positive integer V 


Oy, <b, = op 
for all n = N. If 
lim a, =L= lim cy 
then lim 4, = Z 
15. Divergent Sequences 
We begin with a definition. 


Definition 15.1 Let {a,} be a sequence. We say that {a,' diverges to infinity (minus infinity) and 
write lim, |, a, = © (lim, a, = —00) 1f for every real number M, there exists a positive integer NV 
such that ifn > N, then a, > M (a, <M). 


A sequence which diverges to infinity (or to minus infinity) is unbounded and hence divergent 
because of Theorem 13.2. It is possible to prove analogues of the theorems given in Sections 11, 12, 
and 14 for sequences which diverge to infinity (or minus infinity). We will give two examples and list 
several others as exercises. 


Theorem 15.2 Let {a,} and {b,} be sequences such that lim, ... a, =00 = lim,_,,, b,. Then lim... (a, + 
b) = ©. 


Proof. Let M be a real number. There exists a positive integer NV, such that if > N,, then 
— < @, 


There exists a positive integer N, such that if > N,, then 


Ifn => max {N,, N,}, then 


Theorem 15.3 (Squeeze Theorem) Let {a,} and {b,} be sequences such that a, < b, for every 
positive integer n. If lim,_... b, =— «©, then lim, _.,. a, =— ©. 


n 


Proof. Let M be a real number. There exists a positive integer N such that if = N, then 
b, < M 
Thus ifm > N, we have 
a, 6b,<M 
Exercises 


15.1. Let {a,} be a sequence such that lim, .. a, = 0. Prove that any subsequence of {a,} diverges 
to infinity. 

15.2 Let {a,} and {b,} be sequences such that {a,} diverges to infinity and {b,} is bounded. 
Prove that {a, + b,} diverges to infinity. 

15.3 Prove that the sequence {a,} diverges to infinity if and only if {-a,} diverges to minus 
infinity. 

15.4 Let {a,} and {b,} be sequences such that lim,_... a, =0o=lim,_,., b,. Prove that lim, a,b, = 


n 
oO. 


15.5 State and prove an analogue of Exercise 15.4 for sequences {a,} and {b,} which diverge to 
minus infinity. 

15.6 Let {a,} be a sequence. Prove that {a,} diverges to infinity if and only if there exists a 
positive integer N such that 0 <a, for all = Nand lim, ,,. (1/a,) = 0. 

15.7 What can be said about a divergent sequence which diverges to neither «0 nor —00o? 


16. Monotone Sequences and the Number e 


In order to prove that a sequence {a,} is convergent using Definition 10.2, we must know the value of 
the limit of {a,} in advance. In this section we will prove a theorem which will allow us to prove 
that certain sequences (monotone sequences) are convergent without knowing the value of the limit in 
advance. In Section 19 we will prove a general condition for convergence. 


Definition 16.1 Let {a,} be a sequence. We say that {a,} is increasing (decreasing) if a, <a,., (a, < 
d,.;) for every positive integer n. We say that the sequence {a,} is monotone if either {a,} is 
increasing or {a,} 1s decreasing. 

Ifa, <a,,, (a4, > 4,,,) for every positive integer n, we say that {a,} 1s strictly increasing (Strictly 
decreasing). We say that {a,} is strictly monotone if either {a,} is strictly increasing or strictly 
decreasing. 

If {a,} is an increasing sequence, then {a,} is bounded below by a, and hence {a,} is bounded if 
and only if {a,} is bounded above. Similarly, a decreasing sequence {a,} 1s bounded if and only if 
{a,} 1s bounded below. 


Theorem 16.2 A monotone sequence {a,} is convergent if and only if {a,} is bounded. 


Proof. Suppose {a,,} 1s increasing. (The proof is similar if {a,} is decreasing.) 
If {a,} 1s convergent, then {a,} 1s bounded by Theorem 13.2. 
Suppose {a,} 1s bounded. By the least-upper-bound axiom, the least upper bound L of the set 


X = {a,|neP} 


exists. Let > 0. Since L — ¢ is not an upper bound of the set_X, there exists a positive integer N such 
that L — <<ay,. Since {a,} is increasing, ifn < N we have a, <a,. Thus ifn < N, we have 


LB=—-8<ay 54,5 L<L4+8 


Therefore lim, .. a, =L. m 

One method of finding the limit of a sequence is to prove that the sequence is monotone and 
bounded, then derive an equation which can be solved for the limit. Theorems 16.3, 16.4, and 16.7 
are examples of such a technique. 


Theorem 16.3 Ifjqj< 1, then lim, a” = 0. 


Proof. First suppose that 0 < a < 1. Then {a"} is a bounded monotone sequence, and thus {a”} 
converges by Theorem 16.2. Suppose lim,_,,,. a” = L. By Theorems 11.2 and 12.3, 


L = lim a"*! = lim aa" = a lim a" = aL 
If ZL «0, then a = 1, whichis impossible. Therefore, lim, ., a’ =01f0<a< 1. 
Now suppose — 1 <a<0. Then 0 <~—a< 1 and thus lim,_,.. (-a)” = 0. By Theorem 13.3, 


lim a" = lim (—1)"(—a)" = 0 


avw 


Ifa =0, lim, ., a’ =0 by Theorem 12.1. 


Theorem 16.4 If a > 0, then lim,_,,, a” = 1. 


"™\ is a decreasing sequence bounded below by 1, hence by 


Proof. First suppose that a => 1. Then {a 
Theorem 16.2, {a'"} converges. 


Suppose lim,_,,, a!” =L. Since a'” > 1, by Theorem 14.2, L 4 0. By Corollary 12.7, 


lim a*”" = I? 
By Theorem 11.2, the subsequence {a””"} of {a””"} also converges to L, and since a””” = a'", L = L’. 
Since L #0, L=1. 
If0 <a< 1, then 1 < 1/a, and by the special case above, 


By Theorem 12.9, 


lim a\* = lim = | 


1 
n= 00 nr (Ifa) 


Theorem 16.2 will allow us to define the number e as the limit of the sequence {(1 + 1/n)"}. We 
will use the inequality stated in Lemma 16.5 to prove that the sequence {(1 + 1/n)"} is increasing and 
bounded. 


Lemma 16.5 Let a and b be numbers such that 0 < a < b. Then 


ptt _ gt} 


= <(n+ 1)b 


Proof. If0 <a < 5, then 


pr? — gti 
ee 1)5" 


Proof. If 0 < a < b, then 


pr? nis qt} 


ee ae ae + a*b?-2 +---+ ab + a" 


<b" + bb" ' + bb" 2 +---4+ 1b + 
= (n + 1)” 


Theorem 16.6 The sequence {(1 + 1/n)"} is increasing and convergent. The limit is denoted e. 
Proof. We first rewrite the inequality of Lemma 16.5 as 
b"[b — (n + 1)(b — a) < a®*? 


If we seta = 1+ 1/(n + 1) and b= 1 + 1/n the term in brackets reduces to 1 and we have 


1\* 1 ati 
(1 +7) <(1+>75) 


Next we set a= 1 and b= 1+ 1/2n. This time the term in brackets reduces to 1, and we have 


t VF 
(1+ 5) <2 


2n 
Thus (1 + | <4 
2n 


Since {(1 + 1/n)"} is increasing, 


1\" ; Ls 4 
t: < TF < 


for every positive integer n. Therefore the sequence {(1 + 1/n)"} is increasing and bounded above by 
4. By Theorem 16.2, {(1 + 1/n)"} converges. m 
The proof of Theorem 16.6 shows that 


(145) <4 16.1 


for every positive integer n. On the other hand, since {(1 + 1/n)"} is increasing and (1 + 1/n)" =2 ifn 


= 1, we have 
(+5) 
2<(1l+-]}] <4 
43 


for every ne Pp. By Theorem 14.2, 2 < e < 4 (It can be shown that the decimal expansion of e begins 
2.71828182 - - -). 

The proof of Theorem 16.6 was recently recalled to attention by Johnsonbaugh (1974). It is 
apparently originally due to Fort in 1862 [see Chrystal (1964), vol. II, p. 77]. 

We conclude this section by combining inequality (16.1) with the method of the proofs of Theorems 
16.3 and 16.4 to prove that lim, 2" = 1. 


Theorem 16.7 The sequence {y'/"}2_, is decreasing and lim,_,,. 2’ = 1. 


Proof. We derive the following equivalent inequalities. 


(n - ayers) < nln 


(n he 1)" < ynti 


Ot D ee 16.2 


st} ce is 


By inequality (16.1), (1 + I/n)" <n ifn > 4. It may be verified that (; + 4)3 < 3 and thus inequality 
(16.3) [and hence also (16.2)] holds for all n > 3. 

Therefore {n'"}2., is decreasing. Since {/\*, is bounded below by 1, {n 
Theorem 16.2. 

Let L = lim, n'”. Since n'” > 1 for every positive integer n, by Theorem 14.2, L # 0. By 
Corollary 12.7, 


"converges by 


lim n?/" = I? 
nt © 


and by Theorem 16.4, 


so by Theorem 12.6, 


. n Z/n z 
moe 


By Theorem 11.2, the subsequence {(2n/2)”?"} of {(n/2)?"} also converges to L? and since (2n/2)*?" 
=n'",L=L?.SinceeL ¢0,L=1. q 


Exercises 


16.1 True or false? If the sequence {a,} is not increasing, then {a,} 1s decreasing. 


16.2 Prove that if {a,} 1s a decreasing bounded sequence, then {a,} 1s convergent thus completing 
the proof of Theorem 16.2. 


16.3 Prove that if {a,} is an increasing sequence which is not bounded, then lim,_,., a,, = ©. 
16.4 Prove that ifa> 1, then lim, a” =. 
16.5 Find the following limits 


: 1 \»? 
(2) lim (1 + 2) 


(©) im +" 
tn (1+ 4) 

(©) ten (0 +5)" 

(1) tim (1 + 35) 
16.6 (a) Prove that if 0 <a <b, then 


pti — grtl 


== Se ae De fora = 1,2,... 


(b) Take a= 1+ 1/(n+ 1) and b=1 + 1/n in part (a) and prove that 


(+t) > (1+>45)"[1+255 +4] for“ = 1,2,.... 
(c) Prove that 


1 n : 1 j ; 1 at2 - 
(1+ 45) P+eeatal> (tad MAEEON Chee 


(d) Prove that {(1 + 1/n)"*'} is a decreasing sequence with limit e and that e < 3. 
16.7 Prove that every convergent sequence has a monotone subsequence. 


16.8 Prove the nested interval theorem: If {[a,, 5,]} 1s a sequence of closed intervals such that 


[@n, On) > [Gno1, Ona a] forn=1,2,... 


then nja,, 5,] 1S nonvoid. 
Find a necessary and sufficient condition that 2, {a,, 6,] contains exactly one point. 


16.9 Verify that 
1? < 2% < 3+ 
16.10 (a) Letx and y be positive numbers. Let a, = y, and let 


— O/Gn— 1) + Gn—a 
2 


Gn for z= 1,2,... 


Prove that {a,} 1s a decreasing sequence with limit x. 
(b) Generalize (a) to nth roots. 
16.11° Prove directly from Definition 10.2 that lim, 2!" = 1. 


16.12 Leta, = yaandb, =a,,,/a,. Prove that (,}., is increasing and find the limit. 
16.13 Let {a,} be any sequence of real numbers such that lim, _,,. na, = 0. Prove that 


in(i+t+a)=- 


16.14 (a) Prove that the positive sequence {a,} converges if the sequence {a,,,/a,} is bounded 


above by 1. 
(b) Prove that iflim,_... a,.,/a, exists and is less than 1, then lim, a, = 0. 
16.15 Leta, > 1. Leta,,,=2-l/a, forn=1,2,.... Prove that {a,} 1s a bounded monotone 


sequence and find the limit. 
16.16 Let {a,} be a positive sequence which satisfies a,,,=a,,, +a, forn=1,2,.... 
(a) Assuming that lim, ,.. (a,,,/a,) exists, prove that the value of this limit is ¢@ + y3)j2. 
(b) Prove that lim,_,.. (a,,,/a,,) exists. 


17. Real Exponents 


In this section we make use of the convergence criterion for monotone sequences (Theorem 16.2) to 
define a*, where a > 0 and x is a real (possibly irrational) number. This will complete the definition 
of exponents begun in Section 7. 

It is fairly clear that 3vz should be defined as the limit of a sequence such as 


33 3l4 Bical gi-4id 
We will define a‘, a > 0 and x real, as Jim,.,, a, where {7} is an increasing sequence of rational 
numbers with limit x. We will then verify that the laws of rational exponents carry over to real 


exponents. We first prove that a sequence suchas {7,,} exists. 


Theorem 17.1 If x is a real number, there exists an increasing rational sequence {7} with limit x. 


Proof. Choose (Theorem 7.8) a rational number 7, such that 
y= LST, — x. 


Choose a rational number 7, such that 


l 
max Jr, x ~ 5 1G fg 


In general, having chosen a rational number r,, < x, choose a rational number 7,,,, such that 
] 
max ae i Tl “lati SX 
Clearly {7} is an increasing rational sequence, and since 
1] 
x--<7,< 2x 
fa 


by the squeeze theorem (Theorem 14.3), lim... 7, =x. m 

Ifa 1 and x is a real number, we choose an increasing rational sequence {7} such that lim, .,. 7, 
= x. Then the sequence {a’”} is increasing and if 7 is any rational number such that r > x, {a’"} is 
bounded above by a’. By Theorem 16.2, {a} converges. We define g* = lim,.,, a”. 


Definition 17.2 Let a = 1, and let x be a real number. We define 


a* = lim a" 


h-* o 


where {7} is an increasing rational sequence with limit x. 
If0 <a<1andx is areal number, we define 


We must show that a* is well defined; that is, we must show that the value of a* is independent of 
the choice of the sequence {7,}. 


Lemma 17.3 Let a > 1, and let x be a real number. Let {7} and {s,} be increasing rational sequences 
such that lim,_,.. 7, =x = lim,_,,, s,. Then 


lim a" = lim a 


n=?’ oO nwa 


Proof. Let 


Then {R,} and {S|} are increasing rational sequences and 
ee ee s, = * nm 1, 2,10. 


lim R, = x = lim S, 


By Theorems 12.6 and 16.4, 


lim a" = lim a® lim & = lim a 


n= co n> ow tm? nx 
Since R, <x, we may choose a positive integer m, such that 
R, < Sai 
Since S_,, <x, we may choose a positive integer 1, such that 
Sint < Ry 
Continuing in this way we choose an increasing sequence 
A, = By, 2 hg. Seas 


Let ba, = Sins ba,-1 = Ri, k = i Zz «a8 
Then {6,} is an increasing rational sequence which is bounded, and hence jim, _,,, a exists. Now 


lim a" = lim a®* = lim a® = lim a"! 
n> no k> oo k= oo 
= lim a’* = lim a®™ = lim a" = lim a™ 
kk & k-+ co a 4] r+ wo 


where we have used Theorem 11.2. gy 

The technique used in the proof of Lemma 17.3 is known as the interlacing method and has other 
applications in mathematics. (See the proof of Theorem 84.1.) 

Ifa > 1 andr is a rational number, we may choose the increasing sequence {r,}, where r, =r, n= 
1,2,..., and thus we see that Definition 17.2 is consistent with our earlier definition (Definition 7.7) 
of a’ for r rational. 

The laws of real exponents now follow from the laws of rational exponents by taking limits and 
using Definition 17.2. 


Theorem 17.4 Let a and 5 be positive numbers. Then 
(i) a@'*=aa x,yeR 
(ii) @*P =a” x,yEeR 
(11) (ab) = a*b* xeR 


(iv) g-*= x xeR 
a 6a 

Vv _ = 

(v) (5) Pe xeR 


(vi) Ifa>1andx <y, then a’ <a’. 


(vii) If0<a<1landx<y, thena*>a’. 
(viii) Ifx>O anda <b, thena’<b*. 
(ix) Ifx<0O anda <5, then a> b’. 


Proof. We prove only (1) leaving the other parts as exercises. First suppose a > 1. Let {7} and {s,} 


be increasing rational sequences with limits x and y, respectively. Then {r, + S'} is an increasing 
rational sequence with limit x + y and since 


qin tn = aq" 
we have 


at = lim a**5* = lim ara = lim a” lim a" = a*a” 


an oO nro mo now 


If0 <a<1, then 1/a > 1, and therefore 


ae Nee 


Exercises 


17.1. Prove Theorem 17.4, parts (11) to (ix). 

17.2 Leta> 0, and let x be a real number. Prove that if {7} is any decreasing rational sequence 
with limit x, then @* = lim, a’. 

17.3" Leta>0, and let x be a real number. Let {b,} be any real sequence with limit x. Prove that 
lim, a>» = a*. 

17.4 Let {a,} be a sequence with positive terms such that lim,_... a, = L > 0. Let x be a real 
number. Prove that jim,.... ef = L*. 


18. The Bolzano-Weierstrass Theorem 


In Section 13 we proved that a convergent sequence is bounded (Theorem 13.2), and we noted that 
the converse of this theorem is false. The sequence {(—1)"} is bounded and divergent. Although 
{(-1)"} is divergent, it has a convergent subsequence, {(—1)’”}. The Bolzano-Weierstrass theorem 
states that every bounded sequence has a convergent subsequence. This theorem states a fundamental 
property of the real numbers, and, in fact, it can be shown to be equivalent to the least-upper-bound 
axiom. 


Theorem 18.1 (Bolzano-Weierstrass Theorem) Every bounded real sequence has a convergent 
subsequence. 


Proof. Let {a,} be a bounded sequence. Then there is a closed interval [c, d] such that g, ¢[e, d] for 


every positive integer n. 
Consider the two closed intervals 


c+d c+d d 
c, Ps > pa ’ 
One of these intervals must contain a, for infinitely many positive integers n. We denote this interval 


by [c,, a]. 
We repeat this process with the interval [c,, d,]. One of the intervals 


EB 4 : “|, [254 a, | 


must contain a, for infinitely many positive integers n. We denote this interval by [c,, d,]. Continuing 
this process, we obtain a sequence 


[e,, 4, ], [e2, d2], « « 
of closed intervals such that 


[e,, 4,] > [¢2, d,] > [e3, d5] > «+ 
aan eee ee pee 
and each interval [c,, d,] contains a, for infinitely many positive integers n. 

Choose a positive integer n, such thata, €[c,,4,]. Since [c,, d,] contains a, for infinitely many 
positive integers n, there exists a positive integer n, > n, such that a,, € [c2, d)]. Continuing this process 
we obtain elements a,,,, 

A, o>--. Satisfying 


a, — = 


Gn, & [Cys d,), k = I, 2, bas 18.2 


and Ay < Mz <3 <0 
Therefore, {a,,}f., is a subsequence of {a,}. We will show that {a,,} converges. 

The sequence {c,} is monotone and bounded so by Theorem 16.2, {c,} is convergent. Let L = 
lim,_,,, c,. Similarly, the sequence {d,} converges to some number M. Using equation (18.1), we have 


a= 
im Die Hit — ht eye thin eed) = tin a nl 
kom 


ko k= oo ka 2 
Therefore L = M. Because of (18.2)sequence (Section , we have 


& 54, 3a 


By the squeeze theorem (Theorem 14.3), {a,,} converges to L = M. m 
We will use the Bolzano-Weierstrass theorem to derive a general condition for convergence of a 
sequence (Section 19) and to define a kind of limit applicable to any sequence (Sections 20 and 21). 


Exercises 


18.1 Show (by example) that “bounded” cannot be omitted from the hypotheses of the Bolzano- 
Weierstrass theorem. 

18.2" Prove that every sequence has a monotone subsequence. 

18.3" Let {a,} be a bounded sequence. Prove that if every convergent subsequence of {a,} has a 
limit Z, then lim,_,., a, = L. 

18.4 Let {a,} be a sequence. Prove that if every monotone subsequence of {a,} has limit Z, then 
lim, _,.. @, = L. 

18.5 Let {a,} be a sequence such that for some ¢ > 0, 


|@p — Gm| > & for all n + m 


Prove that {a,} has no convergent subsequence. 


19. The Cauchy Condition 


We begin by deriving a property of convergent sequences. 


Theorem 19.1 Let {a,} be a convergent sequence. Then for every e > 0, there exists a positive integer 
N such that 1f m,n > N, then 


Gn ~ a, <6& 
Proof. Suppose lim,_,,. a, =. Let e > 0. There exists a positive integer N such that ifn > N, then 


é 


la, - Li) <5 


Therefore, if m,n > N, we have 


& 


E 


The condition stated in the conclusion of Theorem 19.1 is known as the Cauchy condition. 


Definition 19.2 If {a,} is a sequence such that for every « > 0, there exists a positive integer NV such 
that if m,n > N, we have 


ay — a| <& 
then we call {a,} a Cauchy sequence. 


Theorem 19.1 states that a convergent sequence is a Cauchy sequence. The converse of Theorem 
19.1 also holds; that is, if {a,} is a Cauchy sequence, then {a,} is convergent. The Cauchy condition 
does not involve the limit, and thus we have a convergence test for arbitrary sequences which does 
not assume that the value of the limit is known in advance. 


Theorem 19.3 Let {a,} be a real sequence. Then {a,} is convergent if and only if {a,} 1s a Cauchy 
sequence. 


Proof. Theorem 19.1 states that if {a,} 1s convergent, then {a,} is a Cauchy sequence and thus we 
must prove the converse. 

Let {a,} be a Cauchy sequence. We first show that {a,} 1s bounded, so that we may apply the 
Bolzano- Weierstrass theorem. If <= 1, there exists a positive integer N such that if m,n > N, then 


la, — a] < 1 
Thus ifn > N, we have 
|a,| = |@, — ayl + lay] < 1 + lay 
Therefore, {a,} 1s bounded by 
max {|a,|, |@z|,.. +5 lay—al, 1 + lawl} 
By Theorem 18.1, {a,} has a convergent subsequence {a,,}. Suppose 


lim a,, = L 
k> 


Let > 0. There exists a positive integer N such that if m,n > N, then 


& 
a _ a,,| <5 


2 


There exists a positive integer N’ such that if k > N’, then 
E 
lan, cam L| tee a 

Choose a positive integer K such that K > N’ and n, > N. Now ifn = N, then 


é & 
la, — L] < |4, — Gayl + 1, - EL < 5 +5 =e 


Exercises 


19.1 Let {a,} and {b,} be Cauchy sequences, and let c be a real number. Prove that {a, + 5,}, {a, — 
bt, {ca,}, and {a,b} are Cauchy sequences. 

19.2 Let {a,} be a sequence. Prove that {a,} is a Cauchy sequence if and only if for every «> 0, 
there exists a positive integer N such that ifn = N, thenja, — ayj<. 

19.3 Let 0 <a <1, and let fbe a function from R into R which satisfies 


|f(x) —fO)| < «lx — y| for allx,yeER 


Let a, eR, and leta,,, =f(a,) forn=1, 2,... Prove that {a,} is a Cauchy sequence. 
19.4 Let {a,} be the sequence defined by the relations a, = 1 anda,,, =a, + (1/3") forn=1,2,... 
Prove that {a,} 1s a Cauchy sequence. 


20. The lim sup and lim inf of Bounded Sequences 


The “generalized limits” lim sup, .. a, and lim inf, .. a, are defined for arbitrary (not necessarily 


convergent) sequences {a,}. In this section we will define lim sup, .,. a, and lim inf, a, for 
bounded sequences {a,} and in Section 21 we will extend our definition to unbounded sequences. 

If {a,} is a bounded sequence, the Bolzano-Weierstrass theorem assures us that {a,} has a 
convergent subsequence. The number lim sup, ,,. a, 18 the maximum value obtainable as the limit of a 
convergent subsequence of {a,} and lim inf, .,. a, is the minimum value obtainable as the limit of a 


convergent subsequence of {a,}. _ 

Definition 20.1 Let {a,} be a bounded real sequence and let z,, denote the set of all Z such that 
as 

where {a,,} iS a convergent subsequence of {a,'. We define 


lim sup a, = lub #, 


nt 


and lim inf a, = glb &, 
Ro ow 
The notations fim 


n> oO 


Let {a,} be a bounded sequence. Then there exists a number M such that ja,)< M for every positive 
integer n. By the Bolzano- Weierstrass theorem, the set 7, 1s not empty. The set 7, is bounded above 
by —M; so by the least-upper-bound axiom, lub 7, exists. Similarly, the set 7, is bounded below by 


a, and lim,.,.. @, are also used for lim sup, ,,. a, and liminf,_.. a,, respectively. 


n—-o n? 


—M; so glb z,, exists. 
Our first theorem follows immediately from Definition 20.1. 


Theorem 20.2 Let {a,} be a bounded sequence. Then 


lim inf a, < lim sup 4a,. 


Example. Consider the sequence {a,} defined by 
a, = (-1)’, ke 
The subsequence {a,,} has limit 1; so 


1 < lim supa4, 


nm?’ 


On the other hand, if {a,,} is any convergent subsequence of {a,}, 


and thus lim 4, < 1 


ko 


Thus | is an upper bound for 7, and so 


lim sup @, < 1 


k= oo 


Therefore lim sup a, = 1 


Similar methods show that lim inf, |, a, =—1. 
The following theorem can be used to characterize lim sup, .,. a, and liminf, ., a,. That is if L and 
M are numbers satisfying the conclusions of Theorem 20.3, then L = lim sup 


a, and M = lim inf, 
a, (see Exercise 20.3). 


no n—oo 


Theorem 20.3 Let {a,} be a bounded sequence, and let L = lim sup,,_,.. a, and M=liminf,_. a,. 
(1) Ife > 0, there exist infinitely many positive integers n such that L — e <a, and there exists a 
positive integer N, such that ifn = N,, thena,<L + «. 
(ii) Ife > 0, there exist infinitely many positive integers n such that a,< M + «and there exists a 


positive integer N, such that ifn >N,,M- e<a,. 


Proof. In this proof we use the notations a,, and a,, interchangeably. We establish part (1) leaving 
part (11) as an exercise. Suppose that it is false that L — e <a, for infinitely many positive integers n. 
Then there exists a positive integer N, such that ifn > N,, thena, <L — «. Let {a,,} be a convergent 
subsequence of {a,}. Ifk>=N,, we have a,, <L — e. By Theorem 14.2, lim... a,, < L — e. It follows 
that L < L — e whichis a contradiction. Therefore L — e <a, for infinitely many positive integers n. 

We next show that L + « <a, for at most finitely many positive integers n, from which it follows 
that there exists a positive integer N such that ifn > N, then a, < L + e. Suppose that L + e <a, for 
infinitely many positive integers n. Then there exists a subsequence {a,,} of {a,} such that lL +e < 
a,, fork = 1, 2,.... By the Bolzano-Weierstrass theorem, {a,,} has a convergent subsequence 
{a,,;$- Thus L + e<a,,, forj = 1, 2,.... By Theorem 14.2, 2 + e< lim,,,, a,,, < L which is a 
contradiction. Therefore L + «<a, for at most finitely many positive integers 7. gy 

If {a,} 1s a convergent sequence, then {a,} is bounded; so lim sup, .,. a, and lim inf, a, are 
defined. It is easy to show that in this case, lim, _,,. a, = lim sup, ,.. a, = lim inf,_,., a,,. 


n—-o n 


Theorem 20.4 
(1) Let {a,} be a sequence such that 


lim a, = L 


na-@ 


Then lim sup a, = L = lim inf a, 


no avo 


(11) Let {a,} be a bounded sequence such that 


lim sup 4, = L = lim infa, 


no nv w 


Then lima, = ZL 


noo 


Proof. (4) By Theorem 11.2, every subsequence of {a,} has limit Z. Thus 7, = {Z} and the 
conclusion follows. 
(ii) Lete>0. By Theorem 20.3(1), there exists a positive integer N, such that ifn > N,, thena, < L 
+ e. By Theorem 20.3(11), there exists a positive integer NV, such that ifn > N,, then L — e< a, 
Therefore, ifn => max {N,, N,}, then 


L-e<a<Lt+e 


Therefore lim, ...a, =. m 


Theorem 20.4 provides another test for convergence. 
Certain theorems may be proved for lim sup and lim inf which resemble theorems for ordinary 
limits. In some cases the theorems are identical. 


Theorem 20.5 Let {a,} and {b,} be bounded sequences such that a, < 5, for every positive integer n. 
Then 


lim sup a, <= lim sup 6, 
nv? o 


na 


and lim inf a, < lim inf 4, 


avt@w no 


Proof. In this proof we use the notations a,, and a,, interchangeably. We will establish the 
inequality involving lim sup and leave the other inequality as an exercise. 

Let {a,,} be a convergent subsequence of {a,} with limit L. Then {b,,} 1s a subsequence (though 
not necessarily convergent) of {b,}. Since {5,,} 1s a bounded sequence, {b,,} has a convergent 


subsequence {b,, } by Theorem 18.1. Since a,,;<b,,, we have 


L = lim ak = lim Qn k,j <= lim Bax, j <= lim sup b, 
ivrcw jira n~> ao 


k= oo 
(why?). Thus lim sup, ,,, 5, is an upper bound for z,,, and we conclude that 


lim sup @, < lim sup 5, 


Theorem 20.6 Let {a,} and {b,} be bounded sequences. Then 


lim sup (a, + 5,) < lim supa, + lim sup 4, 
no 


nso ua 


and lim inf a, + lim inf 6, < lim inf (a, + 6,) 


nv+o@ ua n-@ 


Proof. In this proof we use the notations a,, and a,, interchangeably. We will establish the 
inequality involving lim inf and leave the other inequality as an exercise. 

Let {a,, + 6,,$ be a convergent subsequence of {a, + b,} with limit L. 
The sequence {a,,} has a convergent subsequence {a,,,}, and the sequence {b 
subsequence {b,,.,,}. Now 


} has a convergent 


nkyj nkj 


nk j,i 
L = lim (a, 5 +L bx) = lim (2, x. j,i +. by uit) 
ko i- am 
= lim Fak ji + lim bak, j,i 
i+ co 


i-@ 


> lim inf a, + lim inf 6, 


n-co no 


Thus z,,., 18 bounded below by liminf, ... a, + liminf,_,, b,, and hence 


n—-o n—-o 


lim inf (a, + 5,) = lim infa, + lim inf b, my 


As an example of the use of the previous results, we prove the following theorem. 
Theorem 20.7 Let {a,} be a sequence such that 


lim a4, = L 


n+ 


Then lim Be 7 ie ik =e 


n+ n 


Proof. Let e> 0. There exists a positive integer N such that ifn = N, then 


L-e<a<L+e 


Let p= Se nas 
Now p= SAL 
and since & — AME — 8) — Quart: +" +4 _ (@— NL + 2) 
n n n 

we have 

Cc — N\WL- =i 

Cc, & y 2 25 oe ae \L + 2) 20.1 
where C=a, + a:+++ay 


We apply Theorem 20.5 to inequality (20.1) to get 


lim sup (© + Oa NIE) < lim sup 6, 
= am sup (E+ + Soa) 
nh 
Since lim Me -e ome =0+4+(L—e) 
by Theorem 20.4(1), we conclude that 
L—-—e< lim supd,<L+e, for every ¢ > 0 


now 


By Exercise 4.9, 
L< lim supd, <= L 
n> 
and so L = lim sup b, 
Similarly, L = lim inf b, 
By Theorem 20.4(11), 


L = lim 6, 


We will later have occasion to use the following rather special result. 


Theorem 20.8 Let {a,} and {b,} be sequences such that 


lim a, > 0 
no 
and {b,} is a bounded sequence. Then 
lim sup a,b, = ae sup a, lim sup 6, avi a, lim sup 5, 
n= oO n7>w n= © 


Proof. The last equality follows from Theorem 20.4(1). 
Let L=lim, ,., a,. If LZ = 0, then lim, a,b, =0 by Theorem 13.3, and the conclusion follows. 
Suppose L > 0. Let {a,} be a convergent subsequence of {b,,}. Then 


lim sup a,b, > lim a,,b,, = lim a,, lim b,, = L lim 6,, 
K-00 k> kao 


n= k7 ow 
lim sup a,b, 
Thus ae : 
———— 2 lim 5, 
E, aan 


It follows that 


lim sup 4,2, 


nh oo . 
=e a sup 5, 


and hence lim sup a,b, = L lim sup b, 
nwo 


Let {a,,,5,,,} be a convergent subsequence of {a,b,}. Since {b,,} is the product of the convergent 
sequences {a,,b5,,' and {1/a,,,}, it follows that {b,,} converges. 
] 1 
Therefore, no ma Bin Pony = Em g,,, Ame?) = am 6,,,, = lim sup b, 


Thus lim An Pm, = L lim sup b 


k- x 17> a 
It follows that 


lim sup a,b, < L lim sup b, 


noo no 
lim sup a,b, = L lim sup 6b, = am a, lim sup 6, 
and thus, ””® oom oe 
= lim sup 4, lim sup 8, 
nm co aw 


Exercises 


20.1 Prove that liminf, |, (-1)"=~—1. 

20.2 Prove Theorem 20.3(11). 

20.3 Let L and M be numbers satisfying the conclusion of Theorem 20.3. Prove that L = lim sup 
a, and M = lim inf, ,,. a, 

20.4 Establish the inequality aweliae lim inf in Theorem 20.5. 

20.5 Establish the inequality involving lim sup in Theorem 20.6. 


20.6 Compute limsup, ,,. a, and liminf, ... a,, where a, = 


n—oo 


n—-o 


(a) 1 
1 n 
(ey 
(c) (-1 (1-2) 
20.7 Compute limsup, a, and liminf, a, and 7, where a,, a,, . . . is an enumeration of the 


rational numbers in the closed interval [0, 1]. 
20.8 Let {a,} be a bounded sequence. Prove that there exist subsequences {a,,} and {a,,} of {a,} 
such that 


jim ay, = lim SUP a, Jim Gm, = lim inf a, 
20.9 Let {a,} be a bounded sequence such that every convergent subsequence of {a,} has limit L. 


Prove that lim,_,., a, = L. 
20.10 Give an example of a sequence {a,' such that the sequence 


{* + a2 +:-* a 
Rn 


converges but {a,} diverges. 
20.11 Prove that if {a,,} 1s a subsequence of a bounded sequence {a,}, then 


lim sup @n,, < lim sup @, 
k~ wo a-® 
20.12 Let {a,} be a bounded sequence. Prove that 


lim sup @, = —lim inf (—a,) 
n-7-® no 


20.13 Let {a,} and {b,} be sequences such that {a,} is convergent and {b,} is bounded. Prove that 
lim sup (a, + 5,) = lim sup a, + lim sup by, 
and lim inf (a, + 6,) = lim inf a, + lim inf 4, 
20.14 Let {a,} be a bounded sequence. Suppose that for every bounded sequence {b,} we have 
lim sup (@, + 5,) = lim sup G+ lim sup 5, 
Prove that {a,} 1s convergent. 
20.15 Let {a,} and {b,} be bounded nonnegative sequences. Prove that 
lim inf a, lim inf 5, < lim inf Ayn S lim sur 


20.16 Show (by giving examples) that any of the inequalities of Theorem 20.6 and Exercise 20.15 
may be strict. 

20.17 Show (by giving examples) that the first and third inequalities of Exercise 20.15 may fail if 
the nonnegative hypothesis is omitted. 

20.18 State and prove a theorem analogous to Theorem 20.8 where it is assumed that lim, ,,, a, < 0. 

20.19 Let {a,} and {b,} be sequences such that lim, ., a, <0 and {b,} is a bounded sequence. 
Suppose that 


fim sup auby = im sup im sup 8, 
Prove that {b,} 1s convergent. 
20.20 Let {a,} be a sequence of positive numbers such that lim, ,,. a, = L. Prove that 
lim (a;a2---a,)'"=L 
20.21 (Squeeze Theorem) Let {a,', {b,}, and {c,} be bounded sequences such that 


Gn < On = Cy 


= 


for every positive integer n and 
lim sup ¢, < lim inf a, 
Prove that 
lim a, = lim 5, = lim ¢, 
20.22 Let {a,} and {b,} be sequences such that 


On41 = Gap + Qn+1 


for every positive integer n, and suppose that {b,} is convergent. Prove that lim, (a,/n) = 0. 
Give an example to show that {a,} need not converge. 


21. The lim sup and lim inf of Unbounded Sequences 


In this section we first give another characterization of lim sup, ,,. a, and lim inf, .. a, for bounded 


n—o 


sequences {a,} and then show how this characterization may be used to extend the definitions of lim 
sup, ,,. a, and liminf,_,,. a, to unbounded sequences {a,}. 
If {a,} 1s a bounded sequence, then 


A, = lub {a,, a.21,..-} 
exists for every positive integer 1. Since 
(Gye astliass:< OLR, Gee asexa} 
it follows that 
Ans, SA, forn=1,2,... 


Because {a,} is bounded, the monotone sequence {4,} is also bounded and by Theorem 16.2, {4,} is 
convergent. The next theorem states that lim, .., A, = limsup,,_.,. a, and similarly, 


n—-oo 


lim glb {a,, 2,41, ...} = lim inf a, 
nn? aw neo 


Theorem 21.1 is often taken as the definition of lim sup and lim inf: 


Theorem 21.1 Let {a,} be a bounded sequence. Then 


lim sup a, = lim lub {a,, 4,.,,...} 
and lim inf a, = lim glb {a,, a,4,,...} 


nm? & ato 


Proof. We prove the first equation leaving the second as an exercise. Let L = lim sup, ,.. a,, and let 
A, = lub {@,, 421... .} for n = 1, 2,. 


Since a, < A, for every positive integer n, we have by Theorems 20.4 and 

20.5 that 
L = lim supa, < lim sup A, = lim A, 

Let e> 0. By Theorem 20.3(1), there exists a positive integer N such that ifn > N, thena,<L + «. It 
follows that 4, < Z + e for n = N. By Theorem 14.2, lim, A, < 2 + « Since lim,,,. A, < Z + « for 
every e > 0, we have lim, _.,. 4, < L. Therefore lim... A, =L. m 

Let {a,} be a sequence. If {a,} is bounded above, we let 


A,, = lub {@,, Qaii,- + -} for ae DT 2s 


Then {4,} is a decreasing sequence, and thus either {4,} converges or lim,_,,, A, = —co. Guided by 
Theorem 21.1, we would define lim sup, _,.. a, = lim,_,,, 4,. If {a,} 1s not bounded above, we could 
let A, = 0 forn=1,2,....If we want lim sup, |. a, = lim,_,,, 4,, we would have to define lim 
sup,,,.. @, = © in this case. This discussion motivates the next definition. 


Definition 21.2 Let {a,} be a real sequence. 


(i) If{a,} 1s not bounded above, we define lim sup, .,. a, = ©. 

(ii) If {a,} is bounded above, we define lim sup, ,,. a, =lim,_,,, lub {a,, a,.,,...}. 
(iii) If {a,} is not bounded below, we define lim inf, a, = —©o. 

(iv) If{a,} is bounded below, we define liminf, ... a, =lim,_,,, glb {a,, a,,,,...}- 


By Theorem 21.1, Definition 21.2 is consistent with Definition 20.1. 


Examples. (i) Let {a,} be the sequence defined by a, =n forn=1,2,.... Since {a,} is not bounded 
above, lim sup, ,,, a, =. Now {a,} is bounded below and since 


glb {4,, Qa)... SM for n wil Zc 


it follows that lim inf. = 00, 


n—o a, 


(ii) Let {a,} be the sequence defined by 


—n if 7 is even 
a, = 


0 if m is odd 


Since {a,} 1s not bounded below, liminf,_. a, =—00. 
Since 


lub {4,,@,41,-+-}=0 form=1,2,... 


it follows that lim sup,,_,,. a, = 0. 
Many of the theorems of Section 20 remain valid for unbounded sequences if we accept the 


following conventions. For any x in R, —00 < x, x < 0, and —oo < oo, The set R u {—0} u {oo} with this 
ordering is called the extended real number system. The symbols “— o” and “oo” are not real 
numbers, but are introduced for convenience. We conclude by giving an example of an extension of an 


earlier result (Theorem 20.2) to arbitrary sequences. 
Theorem 21.3 If {a,} is a sequence, then 
A,, = lub {@,, Qaii,- + -} Fer 00 eT cans 


Proof. If {a,} 1s not bounded above, then 


lim infa, < co = lim supa, 
n> co n> 2 
If {a,} 1s not bounded below, then 
lim inf a, = —oo < lim supa, 
n-* oo n> oO 


If {a,} 1s bounded above and below, the conclusion follows from Theorem 20.2. 


Exercises 


21.1 Prove the second equation of Theorem 21.1. 

21.2 LetA,=lub {a,,a,,,,...} and B, =glb {a,,a,,,,...} forn=1,2,.... Compute 4, B, 
lim,_,.. 4,, and lim,_., B., where a, = 

(a) (~1)” 
(b) 1 

1 nm 
ot 
(d) ah 
(©) (-1 (1 —2) 

21.3 Give another proof of the Bolzano- Weierstrass theorem by showing that if {a,} is a bounded 
sequence, there exists a subsequence {a,,' of {a,} which converges to lim, _,,, lub {a,, a,,,,.. 
ots 

21.4 (a) Let {a,} be a sequence which is bounded above. Prove that either {a,} has a convergent 
subsequence in which case lim sup, ,.. a, =lub z,, or {a,} diverges to — 00 in which case lim 
SUP), 400 4 n = 7 &. 

(b) State and prove the result corresponding to (a) for lim inf,_,_. a,. 

21.5 Compute lim sup and lim inf of the following sequences: 

(a) 0, 1,0,2,0,3,... 
(10) It) ea ie Fs 


(C) de 2 sok 
21.6 Let {a,} be a sequence. Prove that there exist subsequences {a,,} and {a,,} of {a,} such that 


lim an, = lim sup a, and lim am, = lim inf a, 
ko ow a+ @ ko aw 


21.7 Prove Theorem 20.4 where L may assume the values — © or ©, 
21.8 Prove Theorem 20.5 for arbitrary sequences {a,} and {b5,}. 
21.9 State and prove a version of Theorem 20.3 valid for arbitrary sequences. 


V 


Infinite Series 


The present chapter can be viewed as an extension of the ideas developed in Chapter IV on 
sequences. Infinite series play an important theoretical and practical role in analysis. 


22. The Sum of an Infinite Series 


In order to sum an infinite sequence of real numbers we must employ the notion of /imit. We begin 
with the definition of an infinite series. 


Definition 22.1 Let {a,} be a sequence. For each positive integer n, let 


§, = a + @, trot a= bi ay 
k=l 
An infinite series 1s the ordered pair of sequences ({a,}, {s,}). 
The number a, is called the nth term of the infinite series, and the number s, is called the nth 
partial sum of the infinite series. Instead of using the cumbersome ordered pair notation for an 
infinite series, we will use the notation 


2 
1 4 or Q@,; + Gy +a3 +++: 


to represent an infinite series. It should be understood that the symbolism y_,a, denotes two 
sequences, namely the sequence {a,} of terms of the infinite series and the sequence {s,} of partial 
sums of the infinite series. 

It is important to distinguish between the sequence {a,} of terms and the sequence {s,' of partial 
sums of an infinite series y~_,a,.. We illustrate this with an example. For the infinite series y~_,,(-1)" 


we have a, = (— 1)” and 


—l if n is odd 
5, = form =1,2,... 


0 if m is even 
The sequence {(— 1)*"} is a subsequence of {(— 1)"}. The nth term of the series y# ,,(—1)™ is 1, and 
the nth partial sum of this series is ¢, =n forn = 1, 2,... . Notice that although {(— 1)?"} is a 
subsequence of {(— 1)"}, {z,} bears little resemblance to {s,}. 


Sometimes it 1s convenient to begin the index of an infinite series with an integer other than 1. For 
example, we may consider the series »*. a) or, in general, »~_,a, where p is an integer. The sequence 
of partial sums as defined in Definition 22.1 will be altered in the obvious way. 

To sum an infinite series, we simply add on more and more “terms.” This corresponds to taking the 
limit of the sequence of partial sums. We make this notion precise in the following definition. 
Definition 22.2 Let y~_,a, be an infinite series. If the sequence of partial sums {s,} (s, =a, ++ °° + 
a,) converges to L, we say that the infinite seriesy~_,a, converges to L or that the infinite series y=, 
a, has sum L. If the sequence {s,,} diverges, we say that the infinite series y=_,a, diverges. 

If the infinite series y~ ,a, converges we also use the symbolism y~_,a, to denote its sum. We are 


n=1°n 
using the notation »2_,a, in two very different ways. For an arbitrary sequence {a,} we will speak of 
the infinite series y~_,a,. Only for a convergent infinite series will we write y ,a,=, where L is the 


sum of the series y ,a,The context will always make clear whether we are speaking of the infinite 
series or the sum of a convergent infinite series. 
Our first theorem shows that if an infinite series is convergent, the terms of the series get small. 


Theorem 22.3 If the infinite series y~_,a, converges, then lim, ,,, a, = 0. 
Proof. Suppose the infinite series »»_,a, converges to L. Lets, =a, ++ -* - +a, be the nth partial 
sum. Then 


Seti — Sy = Syd 


and so 
0 — £, ome L = lim Sati —_ lim Sp = lim (S,a —_ Sn) = lim Anti 
no n> n> @ n> 0 
Therefore 
lima, =0 
n= og 


By Theorem 22.3 the series ¥* , ni(n + 1) and $2. , n'™ diverge since 


n 
lim —— = 1 = lim nn!" 
no t+ I n= 0 


The converse of Theorem 22.3 is false. We will show later (see Section 24) that the series 2 ,1/n 
diverges even though lim, ,,, (1/n) = 0. 
Our first example of a convergent series 1s the geometric series. 


Theorem 22.4 (The Geometric Series) Let a be a nonzero number. Then 
(1) Eo ar" converges to a/(1 — r) if |r| < 1. 


(ii) yz, ar" diverges ifp,= 1. (7° is defined to be 1.) 


Proof. First suppose yj < 1. Then the nth partial sum of the series y* ,ar" is 


_ =r") 


S, = A+ artes + art! 
l-r 


Since yj < 1, lim,_,,, 7” = 0, and hence lim,_,,, s, =a/(1 —7r). 
If, = 1, then the sequence {ar} does not converge to 0; so by Theorem 22.3, »* ,ar" diverges. m 
Ifa=0, y* ar" converges to 0 for any r. 


Exercises 

22.1 Prove that the series y~_,(—1) and y_,n’/(1+n) diverge. 

22.2 Prove that the arithmetic series y= ,(atnb) converges if and only ifa = b =0. 

22.3 Suppose py < 1. Prove that the series y#, x" converges and find its sum. 

22.4" Prove that the series y=_,1/n(n+1) converges and find its sum. 

22.5 Prove that the series y~_,1/n(nt1)! converges and find its sum. 

22.6 Suppose that the series y~ ,a, converges. Prove that the series »~_,a, converges for every 
positive integer p and lim, ,,. y= ,a,=0. 

22.7 Let {a,} and {b,} be sequences such that for some positive integer N, 


Qn = by ifn>N 


Prove that if yx_,a, is convergent, then y= ,b, is convergent. If the sum of the series 

yz ,a, is L, find the sum of the series y= ,b,. (This exercise shows that altering a finite 
number of terms of an infinite series does not affect the convergence of the series, but 
that it may affect the sum of the series.) 


22.8 Prove that the series »_,a, converges if and only if for every « 0, 


n=1°n 


there exists a positive integer N such that ifn > m => N, then 
| a;| << ¢ 
k=m 

23. Algebraic Operations on Series 


Because convergence of the series ya, 1s defined in terms of convergence of a sequence (namely, 
the sequence of partial sums), we may use many of the theorems about sequences in Chapter IV to 
prove theorems about series. 


Theorem 23.1 Let y= ,a, and y~_,b, be series, and let c be a real number. If ya, converges to L 
and y=_,b, converges to M, then yx ,(a, + b,) converges to L — M, and y-»_,ca, converges to cL. 


Proof. Suppose »-2_,a, converges to L and y-~_,a, converges to M. 
Let S, = a, +--+ Gy 
and ty = b, t++- + by 

be the nth partial sums of the series y*_,a, and y_,b,, respectively. Then {s, + ¢,} is the sequence of 


partial sums of the series y~_,(a, + b,). Now 


lim (s, + t,) =L+M 
and hence -_,(a, + b,) converges to L + M. Similarly, »2_,(a, — b,) converges to L — M and y_,ca, 
converges to cL. q 


There is no simple analogue of Theorem 23.1 for products. It is possible that the series y-*_,a, and 


n=1°n 
both converge yet the series y*_,b, diverges. We will show later (see Sections 24 and 25) that 
r21(-)yva converges, but that y=, (-1)/YM(—-1"/vA)) = D2, 1/n diverges. Even if y2,a, 
converges to y#_,b, converges to M, and y~ ,a,b, converges, the sum of »~_,a,b, is in general not 


n=1° nn n=1°n-n 


remotely related to the product LM. The complication is that the product of the partial sums 


n n 
Y, % Y dy = yb, + Qybg b+ + yd, +--+ + Ady 
k=1 k=1 


involves cross terms a.D 


ib, where i #7, whereas the partial sums 


a,b; f+ 22} a0, 


of the series y_,a,b, involve no terms of the form a, (i #/). 


In Section 29 (Theorem 29.9) we will prove a theorem which deals with the product of two infinite 
series. 


Exercises 
23.1 Complete the proof of .Theorem 23.1 by showing that if y= ,a, converges to L and yx_,b, 
converges to M, then y*_,(a, — b,) converges to L — M and y-=_,ca, converges to cL. 
23.2° Find the sum of the series 


EG) +m 


23.3. Prove that the series y= ,a, converges if and only if the series y= ,ca, converges (c # 0). 
23.4 Prove that if y~_,a, converges and y= ,b, diverges, then »_,(a, + b,) diverges. 

23.5 Give an example of divergent series y= ,a, and y~_,b, such that y~_,(a, + b,) converges. 
23.6 Let a, = (4)" and b, = @)", n= 1,2,... Find the sums of the series 


35 the 5; by and ay GnOn 


23.7 Suppose that for constants c and d, where c # d, 372, (aan + cazn-1) ANd He; (a2, + daz.) CONVETE. 
Prove that »_,a, converges. 


24. Series with Nonnegative Terms 


One of the problems studied in the theory of infinite series is that of determining whether a given 
infinite series converges or diverges. In this section we will prove two tests for convergence of 


series whose terms are nonnegative. Another and often deeper problem is to determine the sum of a 
convergent infinite series. We will show (Corollary 24.3) that yz ,1/n° converges. However, to show 
that y_,1/n° = 17/6, we will have to employ more substantial methods; such as the theory of Fourier 
series (see the example following Corollary 78.7). 

Theorem 24.1 which we will deduce from the test for convergence of a monotone sequence 
(Theorem 16.2) is the foundation of our subsequent results. 


Theorem 24.1 Let »~_,a, be a series with nonnegative terms. Then y_,a, converges if and only if the 
sequence of partial sums {s,} is bounded. 


Proof. Let y_,a, be a series with nonnegative terms. Since a, > 0 for every neP, the sequence {s,} 
is increasing. By Theorem 16.2, {s,} converges if and only if {s,} 1s bounded. m 

Like Theorem 16.2, Theorem 24.1 gives a test for convergence which does not involve a 
preknowledge of the limit. 

Ifa series »~_,a, with nonnegative terms converges to L and {s,} is the sequence of partial sums of 
yz ,a,, then s,< L for every positive integer n, for the proof of Theorem 16.2 shows that L is the least 
upper bound of the set {s,jn «P. The inequality s, < L may also be written s"_, a, < YS, a 


Example. y_,1/n diverges. 
Proof. Lets, = 1+ 1/2 +-+++ In. Then 


gs =loil 

$,=1+42 3 

Se=S,tFttSz Reet H2 
Se=Sethttteede2¢44+4+4+4 =F 


In general one may show that s,,. = (mn +2)/2. Since the sequence {s,} is unbounded, y-_,a,,, diverges by 
Theorem 24.1. 
The method of the preceding example may be used to prove the following theorem. 


Theorem 24.2.(2” Test) Let {a,} be a decreasing sequence of nonnegative numbers. Then y_,a, 
converges if and only ify , 2"4.. converges. 


Proof. First assume that 2 , 24.» converges. Now 


a 54 
a, + a3 S a, + a, = 2a, 


Q, + as + ag + Ay < 4a, 
and in general 
Gon + Agngy H+ Gonti-, S 2"Gyn 


If we add these inequalities, we obtain 


2nti-ey 


Sonts—4 = es a= = E aa. = = 2a. 


Thus the subsequence {s,.+:_,} of the sequence of partial sums of y* ,a, 1s bounded by ye , 2a... 
Since the sequence {s,} is a monotone, it follows that the sequence of partial sums of y= ,a, is 
bounded. By Theorem 24.1, »:2_,a, converges. 

Now assume that »-»_,a, converges. Then 


as + ag + Oy + ag > 4a 
and in general 


Gans 5 teret Agnet = 2" Agn+1 


mn a 
2 a, = 5 Pt ess 
k=3 k=1 


Thus the sequence of partial sums of the series y# , 2°4.« 18 bounded, and so y# , 2°4,. converges by 
Theorem 24.1. gy 


Corollary 24.3 The series y_,1/n° diverges ifs < 1 and converges ifs > 1. 


Proof. If s < 0, lim,_,,, (1/n’) # 0; so yx ,1/n’ diverges by Theorem 22.3. 
Suppose s > 0. By Theorem 24.2, y_,1/n’ converges if and only if 


~ — cs 90 —$)n 
ple e ) 2 


converges. By Theorem 22.4, the geometric series y= ,2"'*" converges if 2" ~*) < 1 and diverges if 2 
~) > 1. Thus y-_,1/n’ converges if 1 — s <0 and diverges if 1 —s>0. m 


Exercises 
24.1 Use induction to prove that ifs,=1+1/2+---+1/n, then = @ +2). 
24.2 Assume that there exists an increasing function L from [2, ©) into (0, 0) which satisfies L(x”) 


= nL(x). (The natural logarithm is such a function.) Determine whether the following series 
ee or diverge. 


2. 
| 
© 2.00 
24.3 * Prove that 2, tn? <2. 
24.4 Let yx ,a, be a series with nonnegative terms which diverges, and let {s,} be the sequence of 


partial sums. Prove that lim,_,,, s,, = 00. (In this case we write y~_,a, _,,.) 


(a) 


24.5 Let y~_,a, be a series with nonnegative terms which converges. Let {a,,} be a subsequence of 


{a,}. Prove that y2 ,a, converges and S21 am < 5% ,a,- 

24.6 Let y~,a, be a series with nonnegative terms which converges. Let {b,} be a bounded 
nonnegative sequence. Prove that y= ,a,b, converges. 

24.7 Let {a,} “ {b,} be sequences such that b, > 0 and a, > 0 for every positive integer n. Prove 
that if sy» ,b, converges and the sequence {a,/b,} is decreasing, then »*_,a, converges. 

24.8 State and prove an analogue of Exercise 24.7 where it is assumed that y~_,b, diverges. 

24.9" Prove that if {a,} is a decreasing sequence of positive numbers and y= ,a,, converges, then 


lim,_,,. 2a, = 0. Deduce that y»_,1/n° diverges if0<s <1. 


25. The Alternating Series Test 


In the last section we proved two tests for series with nonnegative terms. In this section we will 
prove a very useful test for series whose terms are alternately positive and negative. In Section 29 we 
will prove several generalizations of the alternating series test. 


Theorem 25.1 (Alternating Series Test) Let {a,} be a decreasing sequence such that lim, | a, = 0. 
Then y-=_ ,(-1)"*'a, converges. 


Proof. If {a,} is a decreasing sequence with limit 0, it follows that a, = 0 for every positive integer 
n. (Why?) We consider the subsequence {s,,,} of the sequence {s,} of partial sums of y= ,(-1)"* 'a,. 
Since {a,} 1s decreasing, a,,,, = @,,,,5, So that 


Sont2 — Ste = —Gane2 + Gone = O 
and the sequence {s,,} is increasing. 
Now 


Soy = Gy — Gz +-** + Gan-i — Fan 


=a, —-(a,- a3) —-**— (an-2 — Arn-1) — Gan S 


Thus the monotone sequence {s,,} 1s bounded. By Theorem 16.2, {s,,} converges. 
Since s,,_, =S,, + @,,, it follows that {s,,_,} converges and 


lim sj,-, = lim s,, + lim a, = lim s2, 
nc ato n~ © n+ 


Since {s,,} and {s,,_,} converge to the same limit, {s,} converges. ™ 
Corollary 25.2 If s > 0, then y <2 (-1)"*'/n* Converges. 


Proof. Apply the alternating series test to the sequence {1/n'°}. m 


Exercises 
25.1 Prove that the series y= , (—1)"* "fe — (1 + 1/n)"] and D2. (—1)"* converge. 
25.2 Let {a,} satisfy the hypotheses of the alternating series test. Let {s,} denote the sequence of 


partial sums of the series y_,(—1)""'a,. Prove that the sequence {s,,_ ,} is decreasing and bounded 
below by 0. 
25.3 Let {a,} be a decreasing sequence with limit 0. Let Z and s, denote, respectively, the sum and 
nth partial sum of the series y~_,(—1)""'a,. Prove that 5, — Lj <,,,,. 

25.4 Give an example of a sequence {a,} of positive numbers such that lim, _,.. a, = 0, but the 

series y#_,(—1)""'a, diverges. 
25.5 In this exercise, let Aa, =a, — a, ,,. 
(a) Verify the identity 


oe ee 1"! ake _ pyri Ga 
ea a dee 
(b) Prove that if 5 (—1)*+1a, converges, so does E (—1)**4Aa, Converges, moreover, 


domes (—1)¥ tay, = ai/2 + § D1 (—1)**? Aggy. 
(c) Prove that if» (—1)"+1a, converges, then 


(—pr Sand 3S (-ntAa < (De 
kes k=en+i 


= (-19 845.5 (I Ay 
( d)’ Bae that if fa,} and {Aa,} strictly decrease to zero and L = Dive, 
(—1)*+4a,, then ap;1/2 < |Dge1 (—1)*+ 4a, — L] < a,/2. 
[Compare this with Exercise 25.3. The right-most inequality is due to Calabrese (1966). The left- 
most inequality is quoted by Boas (1978).] 
(e) Use (d) above to compute exactly the number of terms one must sum in order to approximate y:~_, 
(—1)**'/k to within 4x10° (six-place decimal accuracy). 


26. Absolute Convergence 


The tests of Section 24 apply to series with nonnegative terms. If we are given an arbitrary series 
2 ,a,, we can consider the related series }@ , |a,| whose terms are nonnegative and often get useful 
information by applying the results of Section 24. This idea is captured in the following definition. 


Definition 26.1 Let yz ,a, be an infinite series. If 2, |a,| converges, we say »*_,a, converges 
absolutely. If yx_,a, converges and y~_,a, diverges, we say D* , |a,| converges conditionally. 

Any convergent series with nonnegative terms converges absolutely. The geometric series 2, ,ar" 
converges absolutely if pj < 1. Since $2, (-1)"ny2, (—1)"/n! converges and y= ,1/n diverges, 
¥2,(-1)"/n! converges conditionally. We will develop some tests for conditional convergence in 
Section 28. 

Let yx_,a,be an infinite series. We may relate the series >2 , |a,| and y_,a, by separating {a,} into 
its positive and negative parts. We let 


0 ifa,20 
and = 
— a, ifa, <0 


Then a, =P, ~ 9, and ja,,= p,, + q,, (verify). 

We first justify the terminology of Definition 26.1 by proving the following theorem. 
Theorem 26.2 If y_,a, converges absolutely, then »_,a, converges and |S~ , a,| < DZ, |al.- 

Proof. Suppose 32. , |a,| converges. We let p, and g,, be defined as above. Let {s,} be the sequence 
of partial sums of the series y*_,p,. Then 


Sy = Py eee + Py S ley] +--+ + lel SD lal 


Thus the sequence of partial sums {s,} of the series y*,p, with nonnegative terms is bounded by 
m2, la|. By Theorem 24.1, y= ,p, converges. Similarly, y2,q, converges. By Theorem 23.1, 
r2,a, = ©“ ,(p, — g,) converges. For any positive integer n, we have |yr_, a| < Yx-, |a,|. Taking 
limits we have |y-2,, a,| < 52, la. 

We have already exploited the idea of comparing two series in Theorem 24.2. Now we formalize 
this idea. 


Theorem 26.3 (Comparison Test) Let y~ ,a, and »~_,b, be two series such that 
la,1 = l,l 


for every positive integer n. 
(1) If yb, converges absolutely, then y ,a, converges absolutely and 


(11) If 2 , |a,| diverges, then y~_,a, diverges. 


Proof. If s2_,b, converges absolutely, then 
ja,| + la2] +---+ |a,| < [oil +--+ + 18] = pei by | 


Thus the sequence of partial sums of the series $2, |a,| 1s bounded by yz, |4,|.. By Theorem 24.1, y2, 
a, converges absolutely. Moreover, by Theorem 14.2, 


wo i] 
Y Ia] = lim (la,] +---+ Ja) < ¥ ld 
kel no k=l 


Part (11) is a restatement of part (1) (really?). m 
Example. Since 


for every position integer n and the geometric series ye, , 1/2"-1 converges, by the comparison test 
¥2, (—1)"/n!! converges. Also 


c=] 


=. oe 
2, n! 5 2, ll — 


The comparison test will be used to establish the next three tests. 


Theorem 26.4 Let »~_,a, be an infinite series and {b,} be a sequence. 
(i) If the sequence {b,} is bounded and »-~_,a, converges absolutely, then »~_,a,b, converges 
absolutely. 
(11) Ifthe sequence {1/b,} is bounded and 2 , |a,| diverges, then y~_Ja,b,| diverges. 


Proof. Suppose _,a, converges absolutely and {b,} is bounded. Then there exists a number M 
such that jb,| <M for every positive integer n. Thus 


|4,5,| <= A€|a,| 


for every positive integer n. Since y* , Mja,| converges, y2_,Ja,b,| converges by the comparison test. 


Suppose Y2, |a,| diverges and {1/b,} is bounded. If ys jJa,b,) converges, by part (i), 
(i), ©, |a,b,|/|2,] = E, |e,| converges which is impossible. Thus y-~_,Ja,b,| diverges. m 


n=1 


Corollary 26.5 Let ya, be a series and {b,} be a convergent sequence. 
(i) If ya, converges absolutely, then »x_,a,b, converges absolutely. 
(11) If D2, |a,| diverges and lim, _,,. b, #0, then y-_Ja,b,| diverges. 


Proof. Since a convergent sequence is bounded (Theorem 13.2), part (1) follows immediately from 
Theorem 26.4 (1). 

If lim, ., b, # 0, then lim, ,,, (1/b,) exists and hence {1/b,} is bounded, after a finite number of 
terms. Part (11) now follows from Theorem 26.4. (11). m 


Examples. Consider the series y=, nj + n2). Since n/(1 + n’) = 1/(1/n + n), for large n the series 
r2., n/(1 + n?) behaves like the series y ,1/n. We expect that y= , n/(1 + n?) diverges. Now 


co n wo | n 
iid 


Thus if we take a, = 1/n and b, = n’/(1 + n’), we may use Corollary 26.5 (ii) to conclude that 
r%, ni +n?) diverges. 
Since 


i _f nw | 
rth ala +H 
we may take a, = 1/n* and b, = n’/(n? + n) in Corollary 26.5 (i) and conclude that 5, 1m? + ») 


converges. 


Theorem 26.6 (Ratio Test) Let s_,a, be a series such that 


n=1°n 


Gy+1 


L = lim 


n> 0 


(L = o is allowed) 


(i) IfL <1, then x _,a, converges absolutely. 


=i1°n 


(ii) IfL > 1, then yx ,a, diverges. 


Proof. First suppose that LZ < 1. Choose a number /M/ such that L < M < 1. Then there exists a 
positive integer N such that ifn > N, then 


a 
Sft}<M (why?) 
a, 
In particular, 
Ay +i M 
ay 
SO layz1] < Mlay| 
Also Gn+2) — vg 
GN +1 
SO layeol < Mlay+i| < M7 \ayl 


In general, if is a positive integer, 
layanl < AZ”layl 
The geometric series y=, M"|ay} Converges since 0 < M < 1. By the comparison test y=, Jay,,! 


converges, and hence y= ,a, converges absolutely (verify). 
Now suppose L > 1. There exists a positive integer N such that if n > N, then 


Thus Jay} < layail < laye2l <°°° 
so that the sequence {a,} does not converge to 0 (why?). By Theorem 22.3. y»_,a, diverges. m 

The ratio test gives no information if lim, ,,. ja, , ,/a,| = 1. The series yx ,1/n diverges and the 
series y~_,1/n’ converges, but 


_ Ua@+t |... Ie +I)’ 
yin oe 


Examples. The series y-~_,1/n! converges since the ratio 


Ya+ii_ 1 
I/n! atl 


converges to 0. 
The series y_,n!/n" converges since the ratio 


Ya+ii_ 1 
I/n! n+1 


converges to 1/e < 1/2. Similar arguments show that y_,n"/n! diverges. 


Theorem 26.7 (Root Test) Let {a,} be a sequence and let L = lim sup, ,,. ja,\’". (L = 


(i) IfL <1, then yx _,a, converges absolutely. 
(ii) IfL > 1, then yx ,a, diverges. 


oo 18 allowed.) 


Proof. Suppose L < 1. Choose a number M such that L < M@ < 1. By Theorem 20.3, there exists a 


positive integer N such that ifn > N, then 
la," < M 
Thus if n > N, we have 


la,| < M” 


Since the geometric series yp» ,M" converges, we have that y~_,a, converges absolutely by the 


comparison test. 


Next suppose L > 1. Thenya,'” > 1 for infinitely many positive integers n. Thus ja,|> 1 for infinitely 
many positive integers n, and hence the sequence {a,} does not converge to 0. By Theorem 22.3, yx, 


a, diverges. m 


As in the ratio test, iflim sup, ,., ja,” = 1, the root test gives no information. We have 


1 l/n ‘ 1 Lin 
lim @ = 1 = lim (=) 
noo a nw n 


but y= ,1/n diverges and y_,1/n° converges. 


Examples. =. diverges since lim... (oy 


lim, .,. (QY'1!" = 4. DZ, nG)" converges since lim, 9Q)T"” =lim,,, !!"-4 = 4. 
a « 


Exercises 
26.1 Determine whether each of the series converges absolutely, converges 


conditionally, or 


diverges. 


x (—1j"+1 (- 1)"+1 
© ieper: © 25a 


(c) ¥ (—1*t*(/n +1 — yn (d) e n{—1)" 


n=l tt n=1 2"(n -+- 1) 

2 2(—1¥" © (—1)" 
© 2s © 2G pi 
@ FoR wt 3 pm — 0 

© 0 san a 4B cep on tf 
o Fcrfe-0+4'] oF Bor ee 


26.2 Show (by example) that if {a,} is a sequence such that lim inf... a,j’ @" 2n=1% an may 
either converge or diverge. 

Prove that if lim inf,_,.. ja," > 1, then y=_,a, an diverges. 

26.3 Use Theorem 19.3 to prove Theorem 26.2. 

26.4 Prove that if y~_,a, converges absolutely, then 52, a? converges. 


26.5 Let yx ,a, and yb, be absolutely convergent series. Prove that the series p#, ./a,5,] 
converges. 


26.6° Prove that the series y~_,a, converges absolutely if and only if for every ¢ 0, there exists a 
positive integer N such that 


|@ny + @nz +++++ Qn,| < 


wherever n,,..., ”, are distinct positive integers exceeding N. 
26.7 Let {a,} be a sequence of nonzero numbers. Prove that if 


lim sup ica <1 
then »-_,a, converges absolutely. Prove that if 


lim inf pe | 


+o 


Ant 
Gq, 


then »-~_,a, diverges. 


26.8 Let {a,} be a sequence of positive numbers. Prove that if 


lim 24 = L 


pea Gy 


then lim awa L 
Deduce 


: 7 
lim —ia = @ 
"0D (#!) . 


26.9 Let {a,} be a sequence where each term is one of the integers 0, 1, 2, 3, 4, 5, 6, 7, 8, 9. Prove 
that the series y=, a,/10" converges and the sum is in the closed interval [0,1]. The term.a,a, . . 


. 1s called the decimal expansion of the number y=, a,/10". 

26.10=x" Prove that if xe[0,1], there exists a sequence {a,}, where each termis one of 0, 1, 2,... 
9, such that y=, a,/10". 

26.11" Let r,= mz,.,1/k1 be the error in approximating yz, yx: with pz, 1x1. Prove that 


nm -- 2 1 


1 
@+pi~*<;5igsD! 


Find the least n necessary to have r, < 3 x 10-12, (This gives 10-place decimal accuracy.) 
27. Power Series 


A power series is the infinite series generalization of a polynomial. 


Definition 27.1 Let ¢ be a fixed real number. A power series (expanded about t) 1s an infinite series 
of the form 


y a,(x — ty" 


where {¢,}2., 1S a Sequence and x is a real number. [(x — £)° is defined to be 1.] 
A power series y2., a(x — 1)” converges (absolutely) ifx = ¢, for then the series becomes 


@+0+0+--- 


We will show that there exists a value R, where RF is either oo or a nonnegative number, such that 
Y*.9 a,(x — ¢)" converges absolutely if — 4 < RK and diverges iff — 4 > R. 


Theorem 27.2 Let y@., a(x — t)’ be a power series. 
Let L = lim sup, ,., jaf’. Let 


0 if L = 0 
1 

Re ZL f#O<-;< Lb < oc 
oO ifL=0 


Then the power series y®., a,(x — ¢)’ converges absolutely if pp — 4 < R and diverges iff, — 4> R. 


l/n In — 


Proof. Suppose {ja,)'"} is unbounded. Then lim sup, ,,, ja,” =. If pe — 4 > 0, we have ja,y’" > Ix 
— 4 for infinitely many positive integers n. Thus ja,(x — t)"|> 1 for infinitely many positive integers n, 
and it follows that y*., a(x — ¢)" diverges. 

Now suppose that {ja,)'"} is bounded, then lim sup,,_,,. ja,” = is a real number. First, suppose L > 
0. By the root test ">", a(x — #)" converges absolutely if lim sup,,_,. ja,(x — 0)"" < 1 and diverges if 
lim sup,,,.. |a@,(x — "|" > 1. However, 


In — 


lim sup ja,(x — 1)"|2/" = lim sup Ja,|"/"|x — ¢| 
itv? 


n+ co 


= |x — ¢| lim sup Ja,|*”" 
= |x — 2t|L 
where we have used Theorem 20.8. Thus y@., a(x — t)? converges absolutely if p — ql < 1 and 


diverges iff — ql > 1. 
Finally, suppose L = 0. Let x be any number. Again by Theorem 20.8, 


lim sup |a,(x — t= |x —t[b=0< 1 
ne? oD 


and by the root test y=, a(x — #)” converges absolutely. m 


Definition 27.3 The value R of Theorem 27.2 is called the radius of convergence of the power series 
dn=0 A(X — 1)". 


Examples. The radius of convergence of a power series is often easily obtained from the ratio test. 
Consider the power series >*. ,n(x —t)". Here 


Ana (% — * 


i 
rs a,x — ry" 


nooo 


so by the ratio test, the series converges absolutely if ~ — lj < 1 and diverges if ~ — lj > 1. Thus the 
radius of convergence of the power series y=, a(x — 1s)" 1s R = 1. Similarly, the power series 
Te a(x — t)"/n and $=, (x — 1)"fn? both have radius of convergence R = 1. These examples also 
show that if p — 4 = R, no conclusions about convergence can be drawn. The series $72, a(x — f)"/n 
diverges iff — lj= 1. The series y=, a(x — #)" diverges ifx — 1 = | and converges if x — 1 =—1. The 
series $=, (x — 1)"/n? converges absolutely if — 1j= 1. The ratio test is limited in its application to 
power series in that 


Ona (Xe — t)"** 
a,{x _ ty’ 


lim 


hoa 


may fail to exist. 


Exercises 
27.1 Find the radius of convergence R of each of the power series. Discuss the convergence of the 
power series at the points p — 4 = R. 


xznn a 


® 2am © 3% 


«2 


© py ee? (d) pi (a : 1)" 


© 2e=9 


nei 2 n(n = 1) 


27.2 Suppose that the power series y*., a,(x — #)” has radius of convergence R. Let p be an integer. 
Prove that the power series 7%, n?a,(x — )", has radius of convergence R. 

27.3 Let {a,} be a decreasing sequence such that lim, ,,. a, = 0. Prove that the power series y=, 
a,x" converges if py< 1 andx # 1. 


27.4 Let {a,} be a sequence such that lim,_... |a,,.,/a,| = L. 


Let 
0 Tfi= » 
1 : 
co ifL=0 


Prove that the radius of convergence of the power series y®., a(x — ry" 1s R. 
27.5 Lety®., a,x — 4)” be a power series. Let ¥ = {|x —#|: D2 |a||x — #” converges}. Let R = lub _X 
if X is bounded and let R = 0 if X is unbounded. Prove that R is the radius of convergence of 


the series Y*., a,(x — t)’. 
28. Conditional Convergence 


We now develop some tests for convergent series which fail to converge absolutely. All of our 
conditional convergence tests depend upon the following theorem. 


Theorem 28.1 (Summation by Parts) Let y~_,a, be an infinite series and let {s,} be the sequence of 
partial sums of y~_,a,. Let {b,} be any sequence. Then for any positive integer n we have 


n 


Py ab, = 2, S(D, — Oy) + SO pet 


Proof. The proof is a straightforward verification. Let s) = 0. Then 


y a,b, = », S(O, — Op41) + 5yB yn Ul 


= 
It 
-~ 


To prove that »x_,a,b, converges using Theorem 28.1, it is enough to prove that the series 
D2 1 Sp(by — By) and the sequence {s,b,,,} Converge. 


Theorem 28.2 Let y~_,a, be a series whose sequence of partial sums is bounded. If y=, |b, — 4,,,| 
converges and lim, _,,. b, = 0, then y= ,a,b, converges. 


Proof. By Theorem 26.4 (i), 9%, s,(b, — 8,41) converges absolutely. Since the sequence {s,} is 
bounded and the sequence {b,,,} converges to 0, {s,b,,,} converges to 0 by Theorem 13.3. By 
Theorem 28.1, »:2,a,b, converges. my 


Corollary 28.3 (Dirichlet's Test) If the sequence of partial sums of the series y» _,a, isy~_,a, 
bounded and {b,,} is a decreasing sequence with limit 0, then y= ,a,b, converges. 


n=1°n 


Proof. The sequence of partial sums of the series y-*_,Jb, _ b,, J 1s given by 


Ss, = |b; — b,| sie 1b, — By+11 
= (5, = bs) tet (6, Darah 
= by by41 


which converges (to b,). By Theorem 28.2, yx_,a,b, converges. m 
Example. Consider the series 
l+4-44+4+4-G+::: 


Letting {a,} be the sequence 


and b, = 1/n, we conclude the series converges by Dirichlet's test. Since the absolute value of the nth 
term of the series 


is greater than or equal to 1/n, this series converges conditionally. 


Corollary 28.4 (Alternating Series Test Revisited) If {b,} is a decreasing sequence with limit 0, 
then y# , (—1)"*44, converges. 


Proof. Let a, = (-1)""! and apply Dirichlet's test. my 
We can deduce another theorem from the summation-by-parts formula by assuming less about 
EZ, |b, — bss] and more about y-~_,a,. 


Theorem 28.5 If y~_,a, and 52 , |b, — 5,4;| are convergent series, then y~_,a,b, converges. 


Proof. By Theorem 26.4 (i), ¥2.,5,(6, — 5,.,) converges absolutely. Since 2%, s,(b, — b,+1) 
converges, 


lim [(6, — 62) + (62 — 53) +--+ , — 4n21)) = lim @ - bi+1) 


exists. Thus the sequence {b,,,} converges, and hence {s,b,,,} converges. By Theorem 28.1, »2_,a,b, 
converges. m 


Corollary 28.6 (Abel's Test) If »~_,a, converges and {b,} is a bounded monotone sequence, then 
yz ,a,b, converges. 


Proof. As in the proof of Corollary 28.3, one shows that y2 , |, — 5,4,| converges. The conclusion 
now follows from Theorem 28.5. my 


Example. The series 


za + 1/n)" 


yo 


converges since the series y=, converges and {(1 + 1/n)"} is a bounded monotone sequence. 


Exercises 
28.1 me = the ae 
(a) 1 t+-F +—q+ > es ae 


(b) ¥ zz pone 
converge conditionally. 
28.2 Suppose that p# , ,/ma@, converges. Prove that py ,a, converges. 
28.3 Give an example of a convergent series Y2., |a,| ac a positive sequence {b,} such that lim,_.. 
b,=0 and b2 , |a,|[b"diverges. 
28.4 Prove Abel's lemma: If {s,} is the sequence of partial sums ofa series 2, |a,| and {b,} is a 
decreasing nonnegative sequence, then 


[2 a,b,| < 5, max {[s,|,..-. | Sul} 


28.5 Prove the following result due to Shohat (1933). Let {a,} be a sequence and let b, = n(a, — 
Qi) torn = 1,2) ass 
(a) Iflim,_,,. na, exists and is nonzero, then yx_,a, and y_,b, diverge. 
(b) If yy _,a, and y= ,b, converge, then lim, .,. na, = 0 and »-_,a,. 
Use (b) to prove the formula 
a | = 1 13 
den? Zageeip 8 tie 
Notice that the last two series converge more rapidly than the series y~_, 1/1’. 
28.6 Let {a,} be a periodic sequence, a, =a, for all n and for fixed p, for which y2_, a, = 0. Let 
{b,,} be a decreasing sequence with limit 0. Prove that y= a,b, converges. 


29. Double Series and Applications 


We begin by denning a double sequence. A double sequence 1s a function indexed by pairs of positive 
integers. 


Definition 29.1 A (veal) double sequence is a function from P x P into R. The image of a double 
sequence a at a point (m, n) is denoted a,, ,,. We will denote a double sequence as {a,, ,}. 
A double sequence {a,, ,} may be alternatively described as an infinite matrix 


ee 


6 ae ae (29.1) 


Definition 29.2 Let {a,,,,} be a double sequence. We say that the sum by rows of the series Sy, 4 Gm. 
exists if for every positive integer m, the series y _,a,,, converges and the series )2_, (S32, ayn) 
converges. In this case we say the sum by rows of the series is the number 72_, (72, a,,,,)- The sum 
by columns is similarly defined. 

Notice that the sum »-2_,a,,,, 18 Just the sum of the entries in the mth row of the matrix (29.1). 

We will be particularly interested in the situation in which the sum by rows and the sum by columns 
exist and are equal. Our first theorem which deals with this has many applications to ordinary infinite 
series. We will prove the main theorem of this section after giving an example. 


mn 


Example. Let yj < | and sj < | and define a,,,, =7"s" for m,n = 0, 1, 2,.... The matrix of the double 
sequence {d,, ,} iS 


ee 


NOW 32.9 Gun = Lo £8 = ™ YZ 5" = r7™(1 — s).. Thus the sum by rows is 


0 cs) a 1 a - 1 1 
abs Cnn) = m=0 “T—s,A0 ~~ [=-sl—-r 


Similarly, the sum by columns 1s Y2.9 (O29 a_i.) = (A/(l — FIL — 5)).. In this example, the sum by 
rows and the sum by columns both exist and they are equal. 


In the proof of the next lemma, the following fact will be used. If y (¥ “na < ys e an) 
m=1 \n=1 


a=1 
converges for every positive integer n, then S2_, (S*_, a,,,) converges for every positive integer k and 


This result follows immediately from Theorem 23.1 since 


m= 


kx [3] wo a) co 
Zz ( > ann) ad », Fin, cf » Gin, sears Ei Crs, k 
=i m=1 m=1 


oe mr = Orn ,2 Were Gn, t.) 


k 
dan) 
m=1 \n=1 


Lemma 29.3 Let {a,,,,} be a double sequence of nonnegative terms. If the sum by rows of the double 
S€TICS }, , Aq, CXISts, then the sum by columns also exists and they are equal. 


WI Ht 


Proof. We are given that the series y~,a,,, converges for every positive integer m and that the 
series $7. , (X, a,,,,) converges. 
Let j be a positive integer. For any positive integer m we have 


k k 7] a co] 
Thus pa an; s z (= ina) S Zz (x ona) 
mad m= \n=1 m=1 \n=1 
By Theorem 24.1, s2_, a,,,, converges for every positive integer 7. 
k i) xa & a i] 
Now YE 20s) ED ae) 2D aes 
a=1 \n=1 m=1 \n=1 m=1 \w=1 


for every positive integer k. By Theorem 24.1, 7” 
exists. Moreover, it follows that 


# ,a,,,) converges. Thus the sum by columns 


= (2, “au ~ S. (2, ona) 5 7 x, (2 = 


Repeating the above argument with the roles of m and n interchanged, we have 


§(b-)=(Es) 


Thus the sum by rows and the sum by columns are equal. ™ 


Theorem 29.4 Let {a,,,} be a double sequence. If the sum by rows of the series ¥,,,, |,,,,| €xiSts, then 
the sum by rows and the sum by columns of the series © exist and they are equal. Furthermore, 
the series paar pan Gn | and pS ah ant in nl? 


Ot dF Bn, 1 


Proof. As in Section 26, we let 


a if a, = 0 
Pun = % 
0 if a, < 0 


0 if Gy» = 0 
and Gin = i 
Bin fa <9 


arin 


We first show that the sum by rows of the series »,,,,, 2, CXists. For any positive integer i we have 


Y Pen SY level < ¥ (¥ lanal) = ¥ ( F tonal) 


1 a=} m=1 


for every positive integer &. By Theorem 24.1, y ,P,,, converges for every positive integer i. Also 


y Pa: .) < = (x nal < S [ mal 


ma) 


By Theorem 24.1, the sum by rows of the series ¥,,, Pn, exists. By Lemma 29.3, the sum by rows and 
the sum by columns of §,,,, 2, exist and are equal. Similarly, the sum by rows and the sum by columns 
of the series ¥,,., Gm, €XISt and are equal. Thus 


Y (3, “ “) - z (z, tna) 7 z, (5, - .) 7 E (5, tne) 


m=1 


By Theorem 23.1, 


= 6 Pm, . 2, (= in) - bs (is Prin — 2, in) 
= by |S, (Pan — dns) | 
* z, (3, _ -) 


Similarly, 
x (3 Pn) = > e inn) = ¥ & ann) 
r= m=1 n=l \m=1 nm=1 \m=1 

and thus the sum by rows and the sum by columns are equal. 


Finally, the series po _ | jy , Gm | CONVET BES Since for every positive 
integer k, we have 


By Lemma 29.3, 72, (©, |a,,,/) converges so the above argument may be modified to show that 
ts Za 1 ae 1 | nt »tt g gum 
Zant aetlegl (OUNCES: E 


Theorem 29.4 is analogous to interchanging the order of integration in a multiple integral. 
We next pursue some applications. 
In a finite sum the order in which the terms occur is irrelevant. For example, 


a +4, + 4, + ag = 44 + a, + G3 + Gy 


We will show using Theorem 29.4, that this fact generalizes to absolutely convergent series. First we 
need a definition of a rearrangement of an infinite series. A rearrangement of »»_,a, will be another 


=1¢n 


infinite series whose terms are the same as those of rz ,a but occur ina different order. 


n=1°n? 


Definition 29.5 A permutation of the set of positive integers is a one-to-one function from #P onto P. 


Definition 29.6 A rearrangement of the series y*_,a, 1S a SerieS YP. @pqm), Where fis a permutation of 
the set of positive integers. 
The function f of Definition 29.6 tells us the new order of terms in the rearrangement. 


Theorem 29.7 Let y~_,a, be an absolutely convergent series. Then the rearrangement S®., ay), Of 
ya, converges absolutely, and 


3] wo 
> Fyn) = x, 3% 
n=l n=1 


Proof. Let {b,,,,} be the double sequence whose matrix 1s 


t f“") a 
1 0 Ayr Oreo 
FY) Arayrers see 
f(s) Qesvcseeves A5(n) 


Pe 


We place a,,) in the f(7)th row and the nth column, and we place zeros everywhere else. The formula 
for 5,,,,, 18 


Bas = 


\ if m = f(n) 


0 otherwise 


SINCE LPP 4 [Band = lanl the series P2_, (O24 [bmal) = Le=1 [@nl COnverges. By Theorem 29.4, 
T21 [E21 Hy p| CONVerges and 


Hb on bn) 


n=1 \m= m=1 
Since [P21 ba nl = l@rqyl it follows that F% , ay,,), converges. Finally, 


x ca x es) ~ 
> arin) = ¥ ( y Ona) —_ > ( ban) = 3 Qn a 
n=l n=1 \mel m=1 \n=1 m= 1 


If one rearranges a conditionally convergent series the sum and even the convergence of the series 
may be affected. For example, consider the alternating (conditionally convergent) series 


x2 (-—1)y"*? 


n=1 n 


Denoting its sum by L, we have 


Inserting zeros does not affect the sum so that 


£ 1 | 1 l 
| danincadt iat aac Wi ia i i” Ve iad allel 
Also fee4 cbt de ee 11 alae 
eiell lees a ee Cal ae oe a a 


Adding these two convergent series, we have 


which is a rearrangement of ©@, (—1)"*"/n with a sum different from L. See Exercises 29.7 and 29.8 at 
the end of this section for further results concerning rearrangements of conditionally convergent 
series. 

If we formally multiply the power series 


Ao + axtaxr>+--» and by + dx + b,x? +--- 
and collect terms, we get the power series 
Agby + (dob, + aybo)x + (Aobz + a,b, + azbo)x? +°-- 
This computation motivates the following definition. 


Definition 29.8 The Cauchy product of the series y,,a, and y*.,b, is the infinite series >. ,C,, 


n=O-n 


where 
n 
C, = ab, 5 a,5,_, rae abo = pi a,b, x 
k=0 


We will use Theorem 29.4 to prove the following theorem concerning products of absolutely 
convergent series. 


Theorem 29.9 Let y@ ,a, and »~.,b, be absolutely convergent series, and let yc, be their Cauchy 
product. Then yz. ,c, converges absolutely and 


So~(Za)(B) 


Proof. Let {d,,,,} be the double sequence whose matrix 1s 


0 a:by a,b, a,b, 
0 0 a,b ab, 
0 0 O — abo 
0 0 0 0 
Then 32. 9 [dent = 14m! 2 [b,|. Thus 
S ; dn, n — ; ™ ; b, = y b, )( Qin ) 
E (E ttaal) = 3 (loa Sal) = (3 wal), a (29.2) 


By Theorem 29.4, 92.4 [/2_9 du ni converges and 


2, (¥ ina) - he, OF dna) 
Now Yodan =e, and thus Y2%,|¢,| converges. Equation (29.2) also holds without absolute 
values and thus $2_9 (D220 den) = (W209 6, (Ea 0 G,)~ Therefore 


i £b4)-EE4)-(ENe) 


Corollary 29.10 If 5~, a,(x — 1)" and Y*, 5,(x — 1)” are power series with radii of convergence R, 
and R,, respectively, then >=, ¢,(x — #)" converges absolutely if p — 4 < min {R,, R,}, and for such x 
we have 


y c{x — ty! = 2 a(x — on || 5 B(x — | 
n=0 n=0 n=0 
where 
= 3 Ob, ~ 5 
k=0 


Proof. The proof follows immediately from Theorem 29.9. 
We close this section with another application of Theorem 29.4 to power series. Suppose that >=. , 
a,x" 1S a power Series with radius of convergence R. Is it possible to represent this power series as a 
power series yb (x—i)" with t # 0? Our next theorem answers this question affirmatively. 


n=O-n 


Theorem 29.11 Let »# ,a,x" be a power series with radius of convergence R. If jf < R, there exists 
a sequence {b,} such that 2. ,b,(x—i)” converges if — 4 < R — jg, and iff — 4<R — jg, then 


n=O-n 


a 


a,x" = Dy b,(x — 2)" 


Proof. Suppose p¢ — 4.< R — 4. Then py <p — 4+ i <R, and thus )2., 2,x* converges. Now 


4 


Saw = $ate—o4er= Sal $ (ero) 


n= m=0 


This series is the sum by rows of the double sequence whose matrix is 


(6)4 0 0 0 
(Jat (a(x — £) 0 0 
(S)azt? (Gaat(x-— 1) Ga(x-t)? 0 
(o)ast? (i)ast*(x — t)  (2)ast(x — 1)? = G)as(x — 1° 


Se (29 3) 
. 


Since p — 4 + |< R, the series ys,, ja,\(x — 1 + ep" converges. But y=, , Ja,|((x — #[ + |e)" 18 the sum by 
rows of the double sequence whose matrix is the same as (29.3) with each term T in (29.3) replaced 
by |7j (check this). By Theorem 29.4, the sum by rows of (29.3) 1s equal to the sum by columns. The 
sum by rows of (29.3) is y#,a,x", and the sum by columns of (29.3) is 
Ln=o 5,(x — t)", where b, = Din=n (nant ".- 
Therefore ? h(x -— ty = ¥ a,x" 

n=0 n=0 


forp —q4<R- tm 


n=O on” ? 


Exercises 


29.1 


29.2 


29.3 


29.4 


29.5 
29.6 


Let [20 a,x — t)" and DX.o b,(x — #)” be power series with radii of convergence R, and R,, 
respectively. Prove that -=., (a, + b,x — ty" converges absolutely iff — 4< min {R,, R,} and 
in this case 


ES Get ble — 1 = Bs ax — 9 + ZS bale — 1" 
Prove that if py < 1, then 
(lx +x? +---)? = 1 4 2x 43x? +--- 


Prove that r2., xf#! converges absolutely for every x and 


Let yx_,a, and y_,b, be absolutely convergent series. Let fbe a one-to-one function from #P 
onto #P x P. Let a, and f,, be defined by the equation f(7) = (a,,, £,,). Prove that the series 
¥ik1 as,bs, converges absolutely and (F2 , aD: by) = Ley Gadi 

Give an example of convergent series y# ,a, and yb, whose Cauchy product diverges. 
Prove that ify*.,a, converges absolutely and y~. ,b, converges, then their Cauchy product 
YC, Converges and H2.9 c = (UF.0 (Leo &,).. Give an example to show that in this case, 


Y2. oC, need not converge absolutely. 


29.7 Let y_,a, be a conditionally convergent series, and let x be a real number. Prove that there 
exists a aaenenent of ya, which converges to x. 

29.8 Let y~_,a, be a conditionally convergent series. Let x and y be real numbers or — © or 00 
satisfying x < y. Prove that there exists a rearrangement of y»_,a, such that if {s,,} denotes the 


sequence of partial sums of the rearrangement, then 
liminfs,=x and limsup 


29.9 Let y@.,a,x" be a power series with radius of convergence R. Let {0,,,,} be a double sequence 
such that 6, ,| <{@,| for all positive integers n and m. Suppose also that lim,,_... 5,,,, = 5, for 
every positive integer n. Prove that y=, 6,x" converges if py < R and 
litthy+0 Dte0 bmeX" = Dio bax" for pq < R. 

29.10 Consider the power series »2, ,x which has radius of convergence R = 1. 

(a) Let j= 1. Disprove the following statement. There exists a sequence {b,' such that if A is 
the set of x for which yz, ,b,(—1)" converges, 
then 4/(—1,1) is nonvoid, and if xeAM(—1,1), then ye ,b,~ — "= ye, x2 This exercise shows that in 
general in Theorem 29.11, one must have jq < R. 


m,n 


(b) Let jj < 1 and s2, 6,¢ — yy be a power series with radius of convergence R* > 0. Suppose 
that if py < 1 and p — 4< R’, we have 52.5 277= 52.5 4,(x — #". Prove that the radius of 
convergence of 72. ,(x — 9" 1S | — jf. This exercise shows that, in general, the value R — 
of Theorem 29.11 is the best possible. 

29.11 Let {a,,,,} be a double sequence. We say that the double series 5, , an, 
every € 0, there exists a positive integer N such that if k, / > N, then 


, converges to L if for 


eae: A Gmn — L| <e 
(a) Prove that under the hypotheses of Theorem 29.4, the double series converges. 


(b) Prove that the double series ¥,,,, a,,,,, converges if and only if for every ¢ 0, there exists a 
positive integer N such that if k, /, p, gq = N, then 


k rf 
[2 Py) mn — > Gm.n| ie 
converges to L and the series y2_, a 


(c)° Suppose the double series 5 nn converges for 


every positive integer m. Prove that the sum by rows of D2. , (©, a,,,,) exists and equals 
1B 


29.12 Prove that the set of permutations of the positive integers is uncountable. 


29.13 Let_X be a set of real numbers. Let |x| = {\x|:x¢ x}. Let S be the set of all finite sums of members 
of |4j. Suppose that S is bounded. 
(a) Prove that X is countable. 


(b) Define XX and justify your definition. 


Ht dF Qn, 1 


29.14 Let y%.,a,x" be a power series with radius of convergence R > 0 and suppose that a, # 0. 


Prove that there exists a power series y,,b,x" with radius of convergence R’ > 0 such that if} 
xj< min {R, R}, we have 


29.15 Leta, =1 anda,=~—1/2"' for n= 2. Let {b,,,,} be the double sequence whose matrix is 


eee eee eee ee esesees 


Show that the sum by columns of the series 5), 4m, €XISts, but that the sum by rows does not exist. 


VI 


Limits of Real-Valued Functions and Continuous 
Functions on the Real Line 


In this chapter we will define the limit of a real-valued function whose domain is a subset of the real 
numbers. We will then derive several limit theorems which are analogous to those we established 
inChapter IV for sequences. We will define continuity and prove the Heine-Borel theorem and then 
use this theorem to show that every continuous function on a closed interval has a maximum and 
minimum. In Chapter VII we will generalize the results of this chapter. 


30. Definition of the Limit of a Function 


We begin with two definitions. 


Definition 30.1 Let X be a subset of real numbers and let geR. We say that a is an accumulation 
point of X if for every 5 > 0, there exists a number x ¢ x such that 0 <p — aj< 45. 

In other words, a is an accumulation point of X if there exist points in_X different from a which are 
arbitrarily near a. The number a may or may not belong to_X. In Section 32, we will need the concept 
of left and right accumulation points. The definition is obtained by modifying Definition 30.1 so that 
the inequality 0 <p — aj < 5 is restricted in the obvious way. For example, a is a /eft accumulation 
point of X if for every 5 > 0, there exists a number x ¢ y such that0 <a—-—x<<5. 


Definition 30.2 Let fbe a function from a subset_X of #R into R, and let a be an accumulation point of 
X. We say that the /imit of f(x) as x approaches a is L and write 


lim f(x) = L 


if for every ¢ > 0, there exists 5 > 0 such that if 0 <p — aj<5 and xe x, then/(x) — Lj <-«. 

The assumption that a is an accumulation point of X assures us that there are points x ¢ x satisfying 
the inequality 0 <pr — aj < 5. 

As in the case of sequences (see Theorem 10.3) we can prove ( Exercise 30.7) that if fhas a limit 
as x approaches a, the limit is unique. This justifies writing lim,_, f(x) = L. 

The inequality pp — aj < 5 states that the distance between x and a is less than 5 and the inequality | 
f(x) — Lj < ¢ states that the distance between f(x) and L is less than ¢. The inequality 0 < ~ — a is 
equivalent to the statement x # a. Thus Definition 30.1 says (roughly) that lim_, f(x) = Z provided that 
the distance between f(x) and L is small (less than g) whenever the distance between x and a is small 


(less than 5) and x # a. The value f(a), if it is defined, is irrelevant as far as the limit at a is 
concerned. 

The inequalities (x) — Lj < g and ~ — aj < 5 are equivalent, respectively, to L — ¢< f(x) <LZ+<¢and 
a-§<x<a-+g. Thus lim, , f(x) =L provided given any open interval (L — g, Z + g) there exists an 
open interval (a — 5, a + 5) such that if xe(@ — 5,a + 5) and x # a, then f(x) «(ZL — e, L + «). See Figure 
30,1, 


Examples. Let f(x) = 3x — 1. We will prove that lim_,, f(x) = 2 directly from Definition 30.2. We are 
required to show that if ¢ > 0, there exists 5 > 0 such that if 0 < pr — lj <6, then(3x — 1) — 2;}<«. Now] 
(3x — 1) — 2)<¢ 1s equivalent to pr — 1) < 2/3, so if we take 5 = ,/3 the limit will be established. The 
formal proof would be given as follows. 

Let ¢ > 0. Set 5 = 2/3 and suppose 0 <pr — 1) <5. Then 


(3x — 1) — 2] = [3(x — 1] < 36 = 8 


Let f(x) =x° +x. We will prove that lim_,, f(x) = 6 directly from Definition 30.2. This time we are 
required to show 


|x + 3\lx — 2] = (x? + x) — 6] <e 


if 0 <p — 2) <5. Notice that the term px + 3) is bounded in any bounded interval. In particular if 7 — 2) 
<1, then pr + 3;< 6. Therefore, iff — 2;< min {,/6, 1}, we have 


bx + Bile — 2] < 62 =e 


The formal proof would be given as follows. 


Figure 30.1 


Let <> 0. Set 5 = min {-/6, 1} and suppose 0 <p — Ij< 5. Thenpr + 3)< 6; so 


x? + x) - 6] = [x + Six - 2 < 6556 


Exercises 


In Exercises 30.1 to 30.5 prove the limit using Definition 30.2. 
30.1 lim_, f(x) =c, where f(x) = c for every real x. 

30.2 lim (6x — 2) = 10 

30.3 lim x? = 4 

30.4 limx? +x? +x+1=4 

30.5 lim 2/x = 1 

30.6 Let 


fl) = 0 if x is rational 
1 if x is irrational 


Prove that lim_, f(x) does not exist for any a. 

30.7 Prove that if fhas limit Z and limit V/ as x approaches a, then L = M. 

30.8 Suppose lim_, f(x) =L > 0. Prove that there exists 5 > 0 such that if 0 <p — aj <5, then f(x) > 
0. 


31. Limit Theorems for Functions 


In this section we will prove some limit theorems for functions which are analogous to those we 
derived earlier for sequences (see Chapter IV, Section 12). We begin by defining algebraic methods 
of combining real-valued functions. 


Definition 31.1 Let f and g be functions from a set_X into R, and let c be a real number. We define 
(i) ISI) =1f@), xeXx 

(ii) (cf )(x) = of(x), = -xEX 

(ii) (fF + (x) =f) +9), xEeXx 

(iv) (f — g)\(x) =f) - g@), = xEeXx 

(vy) 9G) =f@)g@), xEeXx 

(vi) (E)o = nee xe X and g(x) # 0 

The operations imposed on the functions in Definition 31.1 are said to be pointwise operations. 
For example, in Definition 31.1, (111), to compute the value of the function f+ g at the point x, we 
simply add the values of fand g computed at the point x. 

We may prove directly from Definition 30.2 that if lim, f(x) = LZ and lim_,, g(x) = M, then 
lim, f(x) + g(x) =L + M. Let ¢> 0. There exists 5, > 0 such that if 0 <p — aj <45,, then/(x) —Lj <« 
/2. There exists 5, > 0 such that if 0 <p — aj<5,, then jg(x) — Mj < 2/2. Let 5 = min {5,, 5,}. Now if 0 
<p — aj <5, then 


Lf(x) + g(x) — (L + M)| = Lf) - LI + Ig) - My] <5+5= ‘ 
and therefore lim_, f(x) + g(x) = ZL + M. The reader should compare this argument with the proof of 
Theorem 12.2 for sequences. The analogy is more than coincidental as is demonstrated by the 
following theorem which links the definition of the limit of a function with the definition of the limit 
of a sequence. 


Theorem 31.2 Let f: ¥ + R, ¥ < R and suppose a is an accumulation point of X. Then lim_, f(x) = L 
if and only if for every sequence {a,} in X such that lim, a, = a and a, # a for every positive 
integer n, we have lim,_,., f(a,) = L. 


Proof. First suppose that lim, f(x) = LZ. Let {a,} be a sequence in_X such that lim, ... a, = a and a, 
# a for every positive integer n. Let > 0. There exists 5 > 0 such that if 0 < pr — aj < 5, then s(x) — L 
<. There exists a positive integer N such that if n => N, then ja, — aj < 5. Since a, # a for every 
positive integer n, we have 0 <ja, — aj. Therefore,ifn > N, then 


0 < |a, —al <6 
so that 
\f(a@,) — Ll <¢ 


and consequently, lim,_,.. f(a,,) = L. 

Now suppose that lim, _,,. f(a,,) =Z for every sequence {a,} in_X such that lim, a, =a anda, #a 
for every positive integer n. Assume by way of contradiction that lim_,, f(x) # LZ. Then there exists g > 
0 such that for every 5 > 0, there exists an x ¢ x with 0 <p — aj <5, such that f(x) — j= <. 

Let n be a positive integer. Taking 5 = 1/n, we find a number a, ¢ ¥ such that 


| 
0 < |a, — al <= and f(a,) -— Ll =e 


Now {a,} is a sequence in_X such that lim, ., a, =a and a, # a for every positive integer n. Since | 
f(a,,) — Lj = « for every positive integer n, lim, f(a,) # L, and we have the desired contradiction. 
We may use Theorem 31.2 to prove analogues of the theorems of Section 12 for sequences. 


Theorem 31.3 Let f and g be two functions from_X into #R with y eR. Iflim_,, fx) = Z and lim, ,, 
g(x) = M, then 
(i) lim 1f@)| = 121 


(ii) lim cf(x) =cL ceR 
(iii) ini Lf) + 9g) = L+M 
(iv) tim Lx) -g@))=L-M 
@) im fa) = LM 


weve WEN) oh 
(7) im a) ~ Hf 


provided in (vi) that MF 0. 
Proof. We prove only (iii). Let {a,} be a sequence such that lim, a, = a and a, # a for every 
positive integer n. By Theorem 31.2, we have 
lim f(a,) = L lim g(a,) = M 
Hence by Theorem 12.2, lim,_,. [/(a,) + g(a,)] =L + M. 
By Theorem 31.2, lim_,, [(x) +g) =L+M. ag 


Exercises 


31.1 Prove Theorem 31.3 (1), (ii), (iv), (v), and (vi) using Definition 30.2. 

31.2 Prove Theorem 31.3 (1), (11), (iv), (v), and (vi) using Theorem 31.2. 

31.3 Letfand g be functions such that for some 5 > 0, f(x) < g(x) 1f 0 <p — aj< 5. Suppose that 
lim, f(x) = ZL and lim,_,, g(x) = M. Prove that LZ < M. 

31.4 (Squeeze Theorem) Let /, g, and / be functions such that for some 5 > 0, f(x) < g(x) < A(x) 1f 0 
<p — aj< 5. Suppose that lim. f(x) = ZL =lim_,, h(x). Prove that lim, g(x) = L. 

31.5 (Cauchy Condition for Functions) Prove that fhas a limit at a if and only if for every <> 0, 
there exists 5 > 0 such that if0 <p — a< 5 and0<p — aj<g, thens(x) —/)|<«. 

31.6 Define lim sup, ,, f(x) and liminf_,, f(x) and derive some results analogous to those of 
Sections 20 and 21. 


32. One-Sided and Infinite Limits 


It is easy to show that the function 
fo) = 


does not have a limit at x = 0. However, for x close to 0 and x > 0, f(x) is close to 1. The value 1 is 
called the right-hand limit of f at 0. Similarly, restricting our attention to x < 0, we see that fhas a 
left-hand limit — 1 at 0. See Figure 32.1. We now give the formal definition of one-sided limits. 


Definition 32.1 Let f be a function from a subset X of #R into R, and let a be a left (right) 
accumulation point of X. We say that the limit of f(x) as x 


t{x) 


Figure 32.1 
approaches a from the left (right) is L and write 
lim f(x) =L Clim f(x) = I) 


if for every ¢> 0, there exists 5 > 0 such that if0 <a —x <5 (0<x-—a<s5), then/(x) —-Lj)<s. 
The following theorem connects Definitions 30.2 and 32.1. 


Theorem 32.2 If a is a right and left accumulation point of X, then lim_,, f(x) = Z if and only if 
lim, + f(x) = L = lim,.,- f()- 

Proof. Suppose lim,_,, f(x) =L. Let g > 0. There exists 5 > 0 such that if 0 <p — a < 5, thens(x) — L 
(\<elIfa<x<atgs, then0 <p — a <g; so s(x) — L < «. Therefore lim,_,+ f(x) = L. Similarly, 
lim, ..- f() = L- 

Now suppose lim, .,,+ f(x) = L = lim,..,- f(x). Let ¢ > 0. There exists 5, > 0 such thatifa<x<a + 5,, 
then (x) — Lj < g. There exists 5, > 0 such that if a — 5, <x <a, theny(x) —- L)<¢. Lets = min {5,, 5,}. 
Then if 0 <p — aj< 5 eithera<x<atg, ora—5,<x<aso that/(x)-L<s.m 

The symbolism lim... f(x) = Z should mean that f(x) is close to Z for large x. Just as “for large n” 
means n > N, “for large x” means x > M. 


Definition 32.3 Let f X — #R with y cR. We say that the limit of f(x) as x approaches infinity 
(minus infinity) is L and write lim_,,. f(x) = LZ [lim_, _ ,f(x) = L] if for every < > 0, there exists a 
number M such that ifx > M (x < M), then (x) — Lj < g. However, if X is bounded above (below), we 
say lim,_,,.f(x) [lim,_,_,,f(x)] 1s undefined. 

It is easy to show that lim,_,,.(1/x) = 0 and lim,_,_,, (1/x) = 0. 

Infinite limits are linked to one-sided limits by the following fact, whose proof we leave as an 
exercise (Exercise 32.1). lim... (x) =L ifand only if lim... f(1/x) = L. A similar statement holds for 
minus infinity. 

It is possible to generalize many of the results of Section 31 to one-sided and infinite limits. Some 
generalizations are given as exercises. 


Exercises 


32.1 Prove that lim_,., f(x) =Z ifand only if lim_,, + /(1/x) = L. State and prove the analogue for 
minus infinity. 
32.2 Prove analogues of Theorem 31.2 for one-sided and infinite limits. 


32.3. Prove analogues of Theorem 31.3 for one-sided and infinite limits. 

32.4 Prove that if lim... (x) =Z, then lim, ..f(n) = L. 

32.5 Let fbe an increasing function on [a, b] (that is, ifx < y and x, ye fe, aj, then f(x) < f(v)). Prove 
that fhas a right-hand limit at every point c in [a, b) and that fhas a left-hand limit at every 
point c in (a, bj. 


33. Continuity 


If f(x) =x, then lim_, f(x) = a for every a in R. For if, > 0 and we set 5 =, thenif0 <p — aj <5, we 
have f(x) — aj < «. Using Theorem 31.3 (v), we have 


limx'=a', neP (33.1) 


ana 


Using Theorem 31.3 (11) and equation (33.1), we may conclude that if c is in R, then 


lim cx” = ca", neP (33.2) 
Ifp(x) =a,x" +++ + +a,x + a, is a polynomial, we may use Theorem 31.3 (111) and equation (33.2) to 
conclude that 


lim p(x) = lim (a,x" +--+ +++ a,x + ap) 


= 4,0" +++--+ aya +t ay 


If R(x) = p(x)/q(x) is a rational function [p(x) and g(x) are polynomials], we may use Theorem 31.3 
(vi) and equation (33.3) to conclude that 


ams ee 
ee oe) ae (33.4) 
provided that g(a) # 0. 
In each of equations (33.1) through (33.4) we were able to calculate the limit of the function at a by 
simply substituting a for x. When this is possible we say that the function is continuous at a. 


Definition 33.1 Let f be a function from a subset XY of #R into R. We say that fis continuous at a if 
either 
(1) a is an accumulation point of X and lim,_,, f(x) = f(a). 
(11) a is not an accumulation point of X. 
Our next theorem follows immediately from our earlier work. 


Theorem 33.2 If f and g are continuous at a, then each of the following functions is also continuous at 
a 


(1) fA 

(ii) cf for eacheeR 

(iii) f+e 

(iv) f—g 

(v) fg 

(vi) t provided that g(a) #0 


Proof. The proof follows immediately from Theorem 31.3. gm 
We next give an equivalent formulation of continuity. 


Theorem 33.3 Let f be a function from a subset_X of #R into #R and let ge x. Then /f is continuous at 
a if and only if for every <> 0, there exists 5 > 0 such that iff — aj< 5 and xe x, then//(x) — f(a) <«. 

Proof. Suppose that fis continuous at a. First suppose that a is not an accumulation point of X. Let g 
> 0. There exists 5 > 0 such that 


{x|0< |x-—al <d}nX¥=G 


Therefore, iff — aj<5 and xe x, thenx =a, and so f(x) — f(a) =0 <«. 

Now suppose that a is an accumulation point of X. Then lim,_,, f(x) = f(a). Let ¢ > 0. There exists 5 
> 0 such that 1f 0 <p — aj<g and xe x, thens(x) — f(a) < «. Suppose 7 — aj< 5 and xe x. Either p — 
a= 0 or 0<p— aj <6. If — a= 0, then x =a, so that (x) — f(a), =0 <s«. If0<p — aj < 45, then s(x) 
— f(a) < g. In either case, f(x) — f(a) < «. 

Now assume that for every ¢ > 0, there exists 5 > 0 such that if — aj < 5 and xe x, then s(x) — f(a) 
< g. If a is not an accumulation point of X, then f is continuous at a; so suppose that a is an 
accumulation point of X. Then there exists 5 > 0 such that iff — aj<5 and xe x, then (x) — fla) <«. 
Therefore, if 0 < ~ — a < 5 and xe xX, then f(x) — f(a)j < «. Thus lim,,, f(x) = f(a) so that f is 
continuous at a. gy 

Our next theorem shows that the composition of continuous functions is continuous. 


Theorem 33.4 If g is continuous at a and fis continuous at g(a), then f . gis continuous at a. 

Proof. Let g> 0. There exists 5, > 0 such that iffr — g(a)j<45,, then (x) — f(g(a))j < «. There exists 5 
> 0 such that if — a < 5, then g(x) — g(a) <5,. Now suppose pr — qj < 5. Then g(x) — g(a) < 5,3 so | 
Kg(x)) —f(g(a))\ < «, and hence f,. gis continuous at a. m 


Example. f(x) = pq is continuous at every point of #R and g(x) = (3x° + 2x7 + x + 1)/Q@’* + 1) is 
continuous at every point of R; so by Theorem 33.4, 


3x7 + 2x7 4+ x41 
a i 


S(g(x)) = 
is continuous at every point of R. 


Exercises 


33.1 Prove that fis continuous at a if and only if for every sequence {a,} such that lim, a, =a 


we have lim,_,.. f(a,) =/(a). 
33.2 Let fbe defined on [0, 1] by the formula 


(fl if x is rational 
f(x) = {0 if x is irrational 


Prove that fis continuous at no point of [0, 1]. 
33.3 Let fbe defined on [0, 1] by the formula 


fay= { if x is tational 
0 if x is irrational 


Prove that fis continuous only at 0. 
33.4 Let fbe defined on [0, 1] by the formula 


: ifx= mis rational 
fG)= 0 if x is irrational 
1 ifx=0 


(x = m/n is in lowest terms, » <p). Prove that fis continuous only at the irrational points of [0, 
1]. 
33.5 Suppose that fis continuous at every point of [a, b] and f(x) = 0 if x is rational. Prove that 
f(x) = 0 for every x in [a, 5]. 
33.6 Let fbe an increasing function on [a, b]. Prove that the set of points at which f is not 
continuous is countable. 
33.7 Prove that if fis continuous on #R and f(x + y) = f(x) + fiy) for x, yer, then f(x) = ax for 
some geR. 


34. The Heine-Borel Theorem and a Consequence for Continuous Functions 


Let f be a function on [a, b]. We say that fis continuous on [a, b]| if fis continuous at every point of 
[a, b] (at the end-points a and b we demand that lim,_,. f(x) = f(a) and lim,.,- f(x) = f(b). Our 
immediate goal is to prove that if fis continuous on [a, b], then fis bounded on [a, 5]. 

In this section only, we will say that fis bounded on a set X if there exists a number M such that | 
f(x) < M for every xe ¥ n (domain /). According to this definition, f can be bounded on a set_X which 
is not a subset of the domain of f. 

There is a certain finiteness property associated with being bounded. If fis bounded on X and Y, 
then fis bounded on y v y. For if f(x)j < M, for x ¢ x , (domain /) and f(x)) < M, for xe y , (domain 
f), then f(x) < max {M,, M,} for x, ¢ ¥ (domain f). By induction we see that if fis bounded on_X,, X,, 

, X,, then fis bounded on x, u X, u::-u X,. It is easy to see that this result does not extend to 
infinite unions (verify). 

We now show that if fis continuous at c, then fis bounded on an open interval containing c. 


Lemma 34.1 If fis continuous at c, there exists 5 > 0 such that fis bounded on (c — 5, c + §). 


Proof. Taking ¢ = 1, there exists 5 > 0 such that if fv — cj < 5 and x is in the domain of f, then (x) — 
f(c)\ < 1. Therefore, if x e(¢ — 6,¢ + 5) nm (domain f), we have 


FOL = If) — fO| + IFO < 1+ (fC) 


If fis continuous on [a, b], then for each c in [a, b] there exists an open interval /, containing c such 
that fis bounded on J, (Lemma 34.1). Of course the collection {7 | ce [a, 6J} iS infinite, and so we 
cannot conclude that f is bounded on the infinite union vu {J,| ce [a, b]}. However, the Heine-Borel 
theorem (Theorem 34.2) shows that some finite subcollection {7,,,... , Z.,} has the property that 


[a,b] < YU &,, 
i=] 


Since fis bounded on /,, fori =1,..., 1, it will follow that fis bounded on | )r_, /., and hence also on 
[a, DJ. 


Theorem 34.2 (Heine-Borel Theorem) Let y be a collection of open intervals such that 
u Sf > [a, d] 


Then there exists a finite subset {/,,...,Z,} of g such that 
Ube aA 
Proof. Let 
X = eG ]| [a, x] < U I, for some J,,..., ef} 
Now ae/ = (59, fo) for some Je g, and hence if we choose Xo, a < X) < f,, it follows that x, e ¥. Thus X 


is a nonvoid subset of #R which is bounded above; so by the least-upper-bound axiom, X has a least 
upper bound c. Since a < x, <c, we have a <c. 


Now ce/ = (s;, t;) for some Je y. Since s, <c, s, is not an upper bound for_X, and hence there exists 
x > a, xe X, Such that s,; <x <c. By the definition of X, there exists 7,,..., J, ¢ g such that 


lade Uh 


Therefore [a, c] < fe 1| ul 
i=] 


We conclude that ¢ < y and the proof will be complete when we show that c = b. 
Suppose c < b. Since ¢¢ x, there exists /,,..., 1,¢ g Such that 


lade (JI, 


sey 


In particular, ¢ J, = (s2, t2) for some j, | <j <n. Choose d such that c < d< band c < d<t,. Then 
ladle (Ji 
i=1 


and thus ge x. Since d > c, we have a contradiction, and therefore c =). g 
The property of the closed interval [a, b] given in Theorem 34.2 is called compactness, and this 
property will be thoroughly investigated in Chapter VII, Sections 42 to 44. 


Theorem 34.3 If fis continuous on [a, 5], then fis bounded on [a, 5]. 
Proof. By Lemma 34.1, for each ¢¢ fa, 6}, there exists an open interval /, containing c such that fis 
bounded on /.. Since 


[a,b] c v {fc € [a, d]} 
by Theorem 34.2, there exist c,,...,c, in [a, 5] such that 
abe UL, 
1S 4 
Now fis bounded on|{ )r_, /,,, and therefore fis bounded on [a, 5]. m 
Theorem 34.4 If fis continuous on [a, 5], there exist points c and d in [a, b] such that 
f(c) = f(x) = (4) 
for all x in [a, b]. That is, if fis continuous on [a, b], then f attains a maximum and a minimum on [a, 
con By Theorem 34.3, fis bounded on [a, b]. Let 
M = lub {f(x)|xe[a, 5} 


We must show that f(d) = M for some d in [a, b]. Suppose this fails. Then f(x) < M for every x in [a, 
b]. Let 


ox) = WS for x € [a, 5] 


By Theorem 33.2, g is continuous on [a, 6]. By Theorem 34.3, g is bounded on [a, 5], and thus there 
exists a positive number N such that g(x) < N for every x in[a, b]. We have 


1 
M—fo <* 


for every x in [a, b] which reduces to 


fo) <M-= (34.1) 


for every x in [a, b]. Since M — 1/N < M, inequality (34.1) contradicts the fact that M is the least 
upper bound of the set { f(x) | x € [a, 6]}- Therefore f(d) = M for some d in [a, 5]. 


The existence of a minimum is proved ina similar way. gy 
In Section 42, we will generalize Theorems 34.3 and 34.4 (see Theorem 42.6 and Corollary 42.7). 


Exercises 


34.1 Prove that if fis continuous on [a, 5], there exists a point c in [a, b] such that 
f(c) = glb {f(x)|x € [a, b)} 


thus completing the proof of Theorem 34.4. 

34.2 (a) Use Exercise 30.8 and the Heine-Borel theorem to prove that if fis continuous on [a, 5] 

and f(x) > 0 for every x in [a, b], then there exists g > 0 such that f(x) >< for every x in [a, b]. 
(b) Prove the statement in part (a) by considering the function g(x) = 1/f(x) 

34.3. Give another proof of Theorem 34.3 by completing the following argument. If fis not 
bounded on [a, b], there exists a sequence {a,} in [a, b] such that j(a,,)| >. By the Bolzano- 
Weierstrass theorem there exists a convergent subsequence {a,,} of {a,}. Let ¢ = limps. any: 
Then f(c) = lim. f(@n,), Which is a contradiction. 

34.4 Give an example ofa collection y of open intervals such that us = (@, 6) and such that for no 
finite subcollection y of g do we have us > (a, 8). 

34.5 Deduce the Bolzano- Weierstrass theorem (Theorem 18.1) from the Heine-Borel theorem 
(Theorem 34.2). 

34.6 Prove that if fis continuous on [a, b] and ¢ > 0, there exists 5 > 0 such that iff — y<s5 and 


x,y é[a, 6], then f(x) — f(y) <«. 


Vil 


Metric Spaces 


In this chapter, we present an introduction to the theory of metric spaces. Our results generalize much 
of the material in Chapters IV, V, and VI, which were concerned with real numbers. The theory of 
metric spaces generalizes those parts of our earlier work which relied on the notion of distance. 


35. The Distance Function 


If x and y are real numbers, we may interpret pp — y geometrically as the distance between x and y. 
(See Figure 35.1.) Using the notion of distance, we may rephrase the definition of the limit of a 
sequence as follows: lim, ,,. a, = if and only if for every ¢ > 0, there exists a positive integer NV such 
that the distance between a, and L is less than ¢ ifn = N. The definition of the limit of a function also 
involves the notion of distance. Letting d(x, y) =~ — y denote the distance between x and y, we may 
say that lim_,, f(x) = ZL if and only if for every ¢ > 0, there exists 6 > 0 such that if d(x, y) < 0, then 
d(f(x), L) < e. Thus both of our fundamental definitions of limit involve the notion of distance, and we 
would expect to be able to define limits in arbitrary sets provided an adequate notion of distance 
were defined. 

The distance function d(x, y) =p — yis a function from R x R into [0, ©) which satisfies 

(1) d(x, y) = 0 ifand only ifx =y 

(11) d(x, y) =d(y, x) for all peR 

(111) d(x, z) < d(x, y) + d(y, z) for all ,eR 
It turns out that properties (1), (11), and (111) above are enough to determine 


x ¥ 
wf 


[x~y| 
Figure 35.1 
a useful notion of distance in an arbitrary set and we are led to the following definition. 


Definition 35.1 Let V/ be a set. A metric on M is a function d from M = M into [0, ©) which satisfies 
(1) d(x, y) = 0 if and only ifx =y 
(11) d(x, y) = dQ, x) for all yeu 
(111) d(x, z) < d(x, y) + d(y, z) for all ze yg 


Definition 35.2 A metric space is an ordered pair (VM, d), where M is a set and dis a metric for M. 


A metric space is (roughly) a set / together with a distance function (metric) don M. 
Property (111) of Definition 35.1 is called the triangle inequality because of its geometric 
interpretation in the plane. (See Example 35.4.) 


Example 35.3 The pair (R, d) is a metric space, where d is defined by d(x, y) =p — y. The metric d 
is called the usual (or absolute value or Euclidean) metric for R. The space R is understood to have 
the usual metric unless otherwise specified. 

Let R’ = R x R. Geometrically, R? is the plane. 


Example 35.4 We will show that 
d(x, y) = /@ — 1)? + G2 — »2)? 


where x = (x,, x3), » = (74, 92) € R? defines a metric on R’. 
Now 


d(x, y) = /(x, — 1)? + G2 — 2) = 0 


if and only if x, = y, and x, = y,. Therefore, d(x, y) = 0 1f and only if x = y, and hence part (1) of 
Definition 35.1 holds. 
Part (11) of Definition 35.1 holds since 


d(x, y) = f(y - wy + (42 — Yo)” 


= Gi — x) +O, — 2 = dO) 


Finally, we must establish the triangle inequality [part (111) of Definition 35.1]. As is often the case, 
the triangle inequality is the most difficult part of Definition 35.1 to verify. 
Let x = (x, 2), ¥ = (1) 2), Z = (21, Z2) € R?. We must prove that 


JG — 21)" + Ge — Za)’ = d(x, z) < d(x, y) + d(y,2) 
= /(x, — yi) + (x2 — 2)’ 
+ fi — 21)? + (2 — 22)” (35.1) 


Letting a, = (x;— y,), 6; = (v; — Z;), and writing x, — z,= (x;— y,) + (vy; — Zz), 7 = 1, 2, inequality (35.1) 
becomes 


J@, + By)? + (@2 + by) < Jat + ah + ./b} + BF 
Squaring both sides and simplifying, we obtain the equivalent inequality 
ab, + dob, < «f(a? + a3)(b? + 53) 


We show that 


|a,b, + ayb2| < /(@i + a3)(b{ + 53) (35.2) 


for any real numbers a,, a,, b,, b, thus establishing the triangle inequality. 
Squaring both sides of inequality (35.2) and simplifying, we obtain the equivalent inequality 


0 a abs = 2a,b,a,b2 + a3bj 


which in turn may be written 


0 < (a,b, — anb,)? (35.3) 


Since (35.3) holds for all real numbers a,, a,, b,, b,, (35.2) and hence also (35.1) are established. 
Thus the triangle inequality holds for d, and therefore d is a metric for R’. 

The metric d of Example 35.4 is called the usual (or Euclidean) metric for R°. This metric gives 
the usual notion of distance in the plane. The triangle inequality is illustrated in Figure 35.2. 

We will generalize Example 35.4 to n-space in the next section. 


¥ 


z 
Figure 35.2 
Example 35.5 We let /' denote the set of all real sequences {a,} such that y2,a, converges 


absolutely. 
We will show that 


A({a4), (,}) = Yay — bal (35.4) 


defines a metric on J’. 

The series in equation (35.4) converges by the comparison test since ja, — 5,| < ja,| + Ib,| for every 
positive integer n. 

It is easy to verify that parts (1) and (11) of Definition 35.1 hold for d. We will verify the triangle 
inequality. Let {a,}, {b,}, and {c,} be elements of /'. Then 


|Z, ag C,| = a, vio b,| + \5, = Cal 


for every positive integer n, and hence 


k k k 
2, |, — c, = yy la, — b,| a x |b, — Cpl 
d({a,)s {65}) = Y, lay — ea 
< ¥ lay — bel + 3 Ibe — oA 
= d({a,}, (5,3) + d(b,}, {643) 


Therefore d is a metric on /'. 


Example 35.6 Let_X be a set. It is easily verified that 


0 ifx=y 


d(x, y) = 
‘ if x # y 


defines a metric on_X. The metric d is called the discrete metric for X, and we will refer to the metric 
space (X, d) as X with the discrete metric. 


Exercises 


35.1 Verify that the function d of Example 35.5 satisfies Definition 35.1 (1) and (11). 
35.2 Prove that the function d of Example 35.6 is a metric. 
35.3. Let d be a metric ona set M. Prove that 


|d(x, z) — d(y, z)| < d(x, y) 


for all zew. 

35.4 Let M bea set and let d be a function from VW x M into R which satisfies the three properties 
of Definition 35.1. Prove that d: M x M — [0, ). 

35.5 Let (WV, d) be a metric space and let_X be a subset of M. Prove that (X, dj X =X) is a metric 
space. 

35.6 Let /” denote the set of all bounded real sequences, and let c, denote the set of all real 
sequences which converge to 0. 
(a) Prove that 2 © ec !*. 
(b) Prove that the containments in (a) are proper. 
(c) Prove that 


d({an}, {b,}) = lub {|@, —_ B, ||" € P} 


defines a metric on /® [and thus by (a) onc, and /' also]. 
(d) Let d be the metric on /' defined in Example 35.5. Prove that d'(x, y) < d(x, y) for yer. 
35.7 Let (M, d) be a metric space. Prove that 


d's) = FG a's») = min x,y), 


define metrics on M. Prove that d’ and d" are bounded by 1. 
35.8 Let (M,, d,) and (M,, d,) be metric spaces. Prove that (M, x M,, d) is a metric space, where 
d is defined by the formula 


@[(xs, x2), (Ys, ¥2)] = di%i, Vx) + dolX2, Ya) 


The space (M, x M,, d) is called the product metric space. 


35.9 Let H® denote the set of all real sequences {a,} such that ja) < 1 for every positive integer n. 
Hf” is called the Hilbert cube. 
(a) Let {a,},{6,} ¢ #*. Prove that the series 


converges. 
(b) Prove that 


d({a,}, {bn}) = 5 lan = bel 
defines a metric on H”. 


36. R’, P, and the Cauchy-Schwarz Inequality 


We first generalize Example 35.4 to n-space. We let 
R" w {(%1, Xo. +++ %) | %,ER fori=l,...,. a} 


The space R" is called real Euclidean n-space. In case n = 1, R' is identified with the real line; in 
case n = 2, R’ is identified with the plane; and in case n = 3, R° is identified with ordinary 3-space. 
We will prove that 


d(x, y) = ie (x, — J)” (36.1) 


where x = (x,,...,%,); ¥ = (),---,y,)€R” defines a metric on R". For n = 1, d is the absolute value 
metric for the line; for n = 2, d is the usual metric of Example 35.4 for R’; and for n = 3, d gives the 
usual notion of distance in 3-space. The function d of equation (36.1) is called the usual (or 
Euclidean) metric for R". 

To prove that the triangle inequality holds in R’, we must show that if (x,,...,%,), V,---5V,_)s 
and (z,,...,2,)eR", then 


i (x, — %)? < Js (x, — ¥%)? + dS (vy, — %)7 


Letting a, =x, —y, and b,=y, —z, fork =1,...,n and arguing as in Example 35.4, we can show that 


the triangle inequality will be established if we can prove that 


= He et) (3, ti) 


This famous inequality is known as the Cauchy-Schwarz inequality. 


yay 


kel 


Theorem 36.1 (Cauchy-Schwarz Inequality for R") Leta,,...,a, and 5,,..., 5, be real numbers. 
Then 

Baal = /(S)(24) 

kel &=1 k=1 


Proof. If b, = 0 for 1 < k <n, the inequality follows immediately (both sides are zero). Thus 
assume that b, # 0 for some k, 1 <k <n. Then 


ss bz > 0 
kK=1 


Ifx is any real number, we have 


0 < ‘3 (a, _ xb,)* 


k=1 


so thatO < ¥' af — 2x ¥ a,b, + x? YB? 
kK=1 k=] k=1 


for any x. If we let 


and take x = B/C, then 


which reduces to 
0 < AC — B’ 
and the inequality now follows. 


Theorem 36.2 The equation 


ata = [3 Ga — 9? 


where x = (x,,...,%,)) ¥ = O41, --->Y,) € R” defines a metric on R". 


Proof. Parts (1) and (11) of Definition 35.1 are easily seen to hold for d, and part (111) follows from 
Theorem 36.1. gm 


We next generalize R” to “infinite-tuples” which are sequences and generalize the metric of 
Theorem 36.2 to the function 


d({a,}. {b,}) = | YG dy (36.2) 


If equation (36.2) is to be meaningful, the series ye , (a, — 6,)* Must converge, and thus we must 
restrict our attention to those sequences {a,} for which the series »*_, a? converges. 

We let /’ denote the set of all real sequences {a,} for which the series y# , a2 converges. We next 
show that if {4,},{4,} ¢ 7, then the series ye, (a, — b,)? converges, and thus equation (36.2) defines a 
function from /? x /° into [0, 0). Actually we will deduce this result from another theorem which is 
important in its own right. 


Theorem 36.3 If {a,},{,} e, then the series @ , a,b, converges absolutely. 


Proof. By the Cauchy-Schwarz inequality (Theorem 36.1), 


Steal < [CS tea), ti?) 


for every positive integer n. Therefore 


for every positive integer n. By Theorem 24.1, 5®. , a,b, converges absolutely. my 


Corollary 36.4 If {a,},{,} e/, then the series y@. , (a, — b,)* converges. 


Proof. The series y@. , (a, — 6)? is the sum of the three convergent series 


a 2 a 
», a —2 ¥ a, Dy, v3 bf 
= k=1 k= 1 


and therefore converges by Theorem 23.1. m 


Theorem 36.5 The equation 


d (fay), {5,3) = | Y @- by? 


defines a metric on 7’. 


Proof. The series y@ , (a, — b,)* converges by Corollary 36.4. Parts (i) and (ii) of Definition 35.1 
are easily seen to hold for d, and thus we verify only the triangle inequality. 
Let {a,},{b,},{¢,} ¢ #2. From the triangle inequality for R" we have 


[E@-a [3m + + [3 Oo) 
for every positive integer n. Taking limits we have 


ation, tad) =] ¥ (ae — a? 


= d({ay}, (5,3) + d(fby}, (043) - 


By taking limits in Theorem 36.1, we can derive the Cauchy-Schwarz inequality for /’. 


Theorem 36.6 (Cauchy-Schwarz Inequality for /*) If {a,},{,} e /, then the series 52 , a,b, converges 


absolutely and 
= ME 4)(2,4) 


Proof. The series $2, a,b, converges absolutely by Theorem 36.3. The conclusion now follows by 
taking limits in Theorem 36.1. m 


o 


= a,b, 
kal 


Exercises 


36.1 Give the details of the proof of Theorem 36.2. 

36.2 Prove that parts (1) and (11) of Definition 35.1 hold for the metric of Theorem 36.5. 
36.3 Prove that » ¢ # ¢ ¢, and that the containments are proper. 

36.4 Prove that ifm2, a2 converges, then 7, a,fz converges absolutely. 

36.5 Leta,,...,a, be real numbers. Prove that 


< (Eta 
t 


This exercise shows that the absolute value of the arithmetic average does not exceed the 
root mean square average. 
36.6 Show that 


@; +::-t a 
it 


|Z, anbel 4/3 aD (3, 6D 


if and only if there exist numbers s and ¢ such that sa, = tb, for 1 <k <n. Interpret this result 
geometrically for n = 2. 


36.7 Show that the function f(x) =A — 2Bx + Cx’, C> 0, has a minimum at x = B/C. 

36.8 Let {a} «/ and {,} «7”. Prove that {a,6,} €#. 

36.9 Let {a,} ec, and {,} <7”. Prove that {a,4,} ¢c,. Give an example of sequences {a,} and {b,} such 
that {a,} ¢c) and {6,} <1”, but {a,b,} ¢ /?. 

36.10 Let {a,},{5,} e 72. Prove that ¢a,5,} e7%. Give an example of sequences {a,} and {b,' such that 
{ay}, {by} € 1°, Dut fanbn} ¢ co- 

36.11 Let {a,} be a sequence such that {2,4,} «2+ for every sequence (4,} «7+. Prove that {¢,} ez. Show 
(by example) that the above statement is false if /” is replaced by cp. 

36.12 State and prove other results obtained by replacing either or both /''s in Exercise 36.11 by 
any of /', 1’, 1”, or Cp. 

36.13 This alternative proof of the Cauchy-Schwarz inequality for R” was published by Tolsted 
(1964). 
(a) Prove that for any real numbers a and b 


a*+ FF 


ab < 5) 


(b) Leta,,...,a,andb,,...,5, be real numbers. 
Set 4 = (34 a2)¥? and B= (p32 6312. Take a = a,/A and b = b,/B in (a) to derive 


(c) Sum the inequalities in (b) to derive the Cauchy-Schwarz inequality (Theorem 36.1). 


37. Sequences in Metric Spaces 


If (M, d) is a metric space, we will often abbreviate (M, d) to M. When we refer to a metric space M, 
it should be understood that there is a metric defined on M, but that we are not mentioning it 
explicitly. 

A sequence ina metric space M is simply a function from P into M, and we denote such a sequence 
as {q}*,, or more simply {a,}. (We will sometimes find it convenient to use the notation {a)}~ , or 
fa.) The definition of the limit of a sequence in a metric space is a direct generalization of the 
definition of the limit of a real sequence (Definition 10.2). 


Definition 37.1 Let {a,} be a sequence in a metric space (M, d). We say that {a,} converges to (or 
has limit) L, where 7 « yy, and write 


lim a, = ZL 


nc 


if for every ¢ > 0, there exists a positive integer N such that ifn > N, then d(a,, L) < «. If {a,} has a 
limit, we call {a,} a convergent sequence. If {a,} has no limit, we call {a,} a divergent sequence. 


As in the case for real sequences, we can show that the limit of a sequence in a metric space, if it 


exists, iS unique, and so we are justified in writing lim... a, = L. One can also prove that if {a,} is a 
constant sequence (a, = L for every n), then lim, _,,, a, =. Another important fact is that if a sequence 
{a,} in a metric space converges to L, then every subsequence of {a,} converges to L. In each case 
the proof is an imitation of the proof of the corresponding result for real sequences. In an arbitrary 
metric space we will not be able to prove generalizations of the algebraic theorems of Chapter IV, 
Section 12, for in an arbitrary metric space, there may be no algebraic operations defined. 

We now examine the meaning of sequential convergence in some specific metric spaces. In the 
metric space (R, d), where d(x, y) = p~ — y is the usual metric, Definition 37.1 is identical to 
Definition 10.2, and thus a real sequence {a,} converges to L in the metric space (R, d) if and only if 
{a,} converges to ZL according to Definition 10.2. 

Let X be a set with the discrete metric d. Suppose that {a,} converges to L in (X, d). Taking ¢ = 4, 
there exists a positive integer N such that ifn = N, then d(a,, L) < 4. But this implies that d(a,, L) = 0 if 
n = N. Therefore, a, = L ifn = N. We will say that a sequence {a,' is eventually constant if there 
exists a positive integer N such that a, = a, ifn = N. We have just shown that if {a,} converges in CX, 
d), then {a,} is eventually constant. It is easy to verify that the converse of this statement also holds. 

Let {a2 , be a sequence in R”. Then each element a is an n-tuple which we denote 
(a®, a®, ... , a). A listing of the points {g}= , is given below. 


1 1 
a) = (aP, a, ..., af, 2. a?) 


2) (2 2 2) 
a = (ai), ai), ..., a, ..., a) 


sees ere ter eeeeeseeseseee eee er eeseeeas 


eee eee e eee eee reer eee es ee eee eneraee 


In the jth column we find a real sequence {a}z,. The link between convergence of the real 
sequences {a} , for 1 <j <n and convergence of the original sequence {@}" , in R" is given in the 
next theorem. 


Theorem 37.2 Let {a 2, be a sequence of points in R", and let ¢ = (a,a,,...,a,)¢R". Let 
a”) = (a, a,..., a), fork=1,2,.... Then {qj , converges to a if and only if lim,..,, a? = a, for 
j=l1,...,n. 


Proof. First suppose that {g#}=, converges to a. Let e > 0. There exists a positive integer N such 
that if k > N, then d(a, a) < e. Let j be a positive integer such that 1 <j <n. Ifk >N, then 


PAL eae Oe ee 
lay? — a] < j > @f - a)? =d@™, a) <e 
i=1 


and thus lim. af = a,forj=1,...,n. 
Now suppose that lim,..,, a = a, forj=1,...,n. Lete > 0. For each/, 1 <j <x, there exists a 


positive integer N; such that if k > N,, then 


é 
Oo gle< 
|a} a,;| Jn 


Ifk => max {N,,...,N,}, then 


a 
d(d, a) = | 2X, GP — a9 
i= 
2 2 2 2 
é RE 
< [E+ tt oo —=8 | 
ft fi it it 


For example, the sequence 4((1 + 1/x)*, 1/K)}@, Of points in R’ converges to (e, 0), since lim,_,,. (1 + 
1/k)‘ = e and lim,_,,. (1/k) = 0. 

The statement, “Let {a,} be a sequence in /',” is ambiguous. Do we mean that a, is a real number 
for every positive integer n and that y=, a, converges absolutely, or do we mean that g ¢/' for every 
positive integer n and that {a,} is a sequence of points in the metric space /'? To avoid such 
ambiguity, we agree that when we say that {a,} is a sequence in /', we mean that a, is a real number 
for every positive integer n and that y~, a, converges absolutely, that is, {¢,} e. If we wish to speak 
of a sequence of points in the metric space /', we will say that {gj , is a sequence of points inI'. In 
this case , - for every positive integer k. We will use a notation similar to that employed for R’. 
We let a® = {g®}2 ,. Then g® is the nth term of the Ath sequence. A listing of the points {g}= , is 
given below. 


a = (a, 8, ..) 
a) = (dP, oP, ..) 


eee ew wee eee ee 


re 


Theorem 37.2 does not hold for /' (nor for /*, co, /”). For let (5 }2., be the sequence of points in /' 
defined by 


This sequence is listed below. 


5™ = (1,0, 0,0, ...) 

6) = (0,1,0,0,...) 

64) == (G, 0,.1,0, ...) 
Let a, = 0 for every positive integer n, and let a = {a,}. It is clear that jim, ,,, 5 = a, for every 
positive integer n. However, {6“)} does not converge to a in /', since d(O™, a) = 1 for every positive 
integer k. One-half of Theorem 37.2 does generalize to /' (and to 7, cy, 7”) as the next theorem 
demonstrates. 


Theorem 37.3 Let {a} be a sequence of points in /', and let ¢ = {a} 7. If {a} converges to a, 


then lim,..,, a = a, for every positive integer n. 


Proof. Let e > 0. There exists a positive integer N such that if k > N, then d(a, a) < ¢. Letn be a 
positive integer. If k > N, then 


a 
lag? — a, < > laf — a| = da, a) <e a 
i= 


Exercises 


37.1 Prove that the limit of a sequence in a metric space is unique. 

37.2 Let M be a metric space. Prove that if {a,} 1s a sequence in M such that a, = L for every 
positive integer n, then lim, _,., a, = L. 

37.3. Let M be a metric space. Let {a,} be a sequence in M such that lim, ... a, = L. Prove that 
every subsequence of {a,} has limit L. 

37.4 Show (by examples) that Theorem 37.2 does not generalize to /°, cy, or 1”. 

37.5 Prove Theorem 37.3 with /' replaced by /’, c,, 1”. 

37.6 Let {(x,, y,)} be a sequence of points in R’ such that the sequences {x,} and {y,} are 
bounded. Prove that {(x,, y,)} has a convergent subsequence. 

37.7 Let {a} be a convergent sequence of points in/'. Prove that {a converges in /”. 

37.8 Let M, and M, be metric spaces. Let {(x,, y,)} be a sequence of points in the product metric 
space M, x M,. (See Exercise 35.8.) Let (x, »)¢.4, xM;. Prove that lim,_,.. (,, y,) = (@, y) 1f 
and only if lim,_.., x, =x and lim, _.,. v, =). 

37.9 (a) Prove that the equation 


a(x, y) = dls — yl 


where x = (x,,..., %), ¥ = Oy, - » +> Yn) ¢R" defines a metric on R’. 
(b) Let {a} be a sequence of points in R’, and let geR=. Prove that {a} converges to a in 
(R’, d) if and only if {a} converges to a in(R", d’), where d is the usual metric for R’. 
37.10 Let (M, d) be a metric space, and let d’ and d” be defined as in Exercise 35.7. Let {a,} bea 
sequence in M and let ge yg. Prove that the following statements are equivalent. 
(a) {a,} converges to a in(M, d). 
(b) {a,} converges to a in (M, d’). 
(c) {a,} converges to a in (M, d”). 
37.11" Let fa}2 , be a sequence of points in H”. (H” is defined in Exercise 35.9.) Let 
a= {a,}2.,¢H*. Prove that g#}= , converges to a in H” if and only if tim,.... a = a, for every 
positive integer n. 


38. Closed Sets 


A closed interval [a, b] of the real line has the following property. If {x,} 1s a convergent sequence of 


points in [a, b] and lim, ,., x, =x, then x also belongs to the interval [a, b]. For ifa <x, < b for every 
positive integer n, then a < lim,_,,. x, < 6 (Theorem 14.2). We generalize this property to arbitrary 
metric spaces. 


Definition 38.1 Let M be a metric space, and let_X be a subset of M. We say that a point x in Mis a 
limit point of X if there is a sequence {x,} such that x, ¢ ¥ for every positive integer n and lim, _,.. x, = 
x. 


On the real line 1 is a limit point of either of the sets [0, 1] or (0, 1) (Verify). Thus a limit point of a 
set XY may or may not belong to_X. If every limit point of a set _X belongs to_X, we say that X is closed. 


Definition 38.2 Let M be a metric space, and let_X be a subset of M. If every limit point of X belongs 
to _X, we say that_X is closed (in M). 


The discussion preceding Definition 38.1 shows that a closed interval of the real line is a closed 
subset of R. An open interval (a, 5) of R is not a closed subset of R since a is a limit point of (a, 5), 
but a ¢ (a, b). 

A closed rectangle R = [a, b] x [c, d] is a closed subset of R’. For let (x, vy) be a limit point of R. 
Then there exists a sequence {(x,, y,)} 1n R which converges to (x, vy). By Theorem 37.2, lim, _,,, x, = 
x and lim,_,., vy, =y. Since a <x, <bandc <y, <d for every positive integer n,a<x<bandc<y< 
d by Theorem 14.2. Therefore, (x, y) eR, and R is closed. 

Let X be a set with the discrete metric. We show that every subset of X is closed. Let y ~ y, and let 
y be a limit point of Y. There exists a sequence {y,} in Y such that lim, vy, = y. Now {y,} is a 
convergent sequence in_X, and thus {y,} is eventually constant (Section 37). Therefore, y, = y for 
some positive integer n, and thus ye y and Yis closed. 

We return now to arbitrary metric spaces. 


Definition 38.3 Let V/ be a metric space, and let X be a subset of M. We let x denote the set of limit 
points of X. 


It is easy to verify that y — x for if yey, we may let x, =x for every positive integer n and then 
{x,} 18 a sequence of points in_X such that lim,_.,. x, =x; therefore , ~ 7. We may combine Definitions 
38.2 and 38.3 into a single statement. A subset X of a metric space M is closed if and only if X = x. 


Theorem 38.4 Let M be a metric space and let x ¢ ag. Then M, @, and {x} are closed subsets of M. 


Proof. If x is a limit point of M, then x ¢ yg by definition, and therefore M is closed. 

Suppose g@ is not closed. Then there exists x ¢ 4g such that x is a limit point of @, but x ¢ @. Thus 
there exists a sequence {x,} in g@ such that lim, ,,. x, =x. But now x e @ for every positive integer n, 
which is impossible; therefore g is closed. 

Let y be a limit point of {x}. Then there exists a sequence {x,} in {x} such that lim, x, =y. Since 
x, € {x} for every positive integer n, it follows that x, =x for every positive integer n. Thus y = lim,_,, 
x, =x, and so ye {x}. Therefore {x} is closed. m 


Theorem 38.5 Let X and Y be closed subsets of a metric space. Then y | y is closed. 


Proof. Let x be a limit point of y VW y. Then there exists a sequence {x,} in y y y such that lim, 
x, = x. Either x,e¥ for infinitely many positive integers m or x,¢ ¥ for infinitely many positive 
integers n. We may assume x,e¢X for infinitely many positive integers n. Suppose x, eX, ny <n < 
ng <--+. Now lim... %,, = x3 SO x is a limit point of X. Since X is closed, x ¢y. Therefore xe xu Y; 
so xu y 18 Closed. my 


Corollary 38.6 If X,, X,,... , X, are closed subsets of a metric space, then ¥, UX, U---u X, 18 
closed. 


Proof. The proof follows by induction from Theorem 38.5. 


An infinite union of closed subsets of a metric space need not be closed. For example, 


a i n 
= ed E n+ q 


(verify), and [1/n, n/(n + 1)] is closed in R for each positive integer n, but (0, 1) is not a closed 
subset of R. An arbitrary intersection of closed sets is closed, as we will show in Theorem 38.8 after 
deducing one more corollary of Theorem 38.5. 


Corollary 38.7 Any finite subset of a metric space is closed. 


Proof. If {x,,...,X,} 1S a finite subset of a metric space, then {x,,...,x,} = {x,} U'--u {x,} 1s 
closed by Theorem 38.3 and Corollary 38.6. ™ 


Theorem 38.8 Let g be a collection of closed subsets of a metric space. Then , ¢g is closed. 


Proof. Let x be a limit point of , g. Then there exists a sequence {x,} in, g such that lim, x, = 
x. Letceg. Then x, ec for every positive integer n. Since lim, |. x, =x, x is a limit point of C. Since 
C 1s closed, xec. Thus xe ¢ for every ce g. Therefore, x ea g and hence q gis closed. m 


Exercises 


38.1 Give the inductive proof of Corollary 38.6. 
38.2 Let (a, b) be an open interval in R. Describe sequences {a,} and {b,} in (a, 5) such that 
lim,_,.. 4, =a and lim, b, = 5. 
38.3 Prove that a half-open interval / is not a closed subset of R unless J = (— «, b] or J=[a, «). 
38.4 Let M be a metric space such that M is a finite set. Prove that every subset of / is closed. 
38.5 Let_X be a subset of a metric space M. We say that a point x in M is an accumulation point of 
X if there exists a sequence {x,,} in_-X such that lim, ., x, =x and x, #x for every positive 
integer n. We let_X* denote the set of accumulation points of X. 
(a) Prove that_X is closed if and only if x*c x. 
(b) Prove the following form of the Bolzano- Weierstrass theorem: If X is a bounded infinite 
subset of R, then X’ # @. 


(c) Prove that if X is an uncountable subset of R, then X’ # @. 
38.6 Let/fbe a continuous function from R into R. Prove that {x/(x) = 0} is a closed subset of R. 
38.7 Let {5} _, be as in Section 37. Prove that (gx ep} is a closed subset of /', /’, c°, and /”. 
38.8 LetX and Ybe closed subsets of R. Prove that_XY x Yis a closed subset of R’. State and prove 
a generalization to R’. 
38.9 Let (M, d) be a metric space. Let ¢ > 0 and let yew. Prove that the closed ball {xd(x, y) < €} 
is a closed subset of M. 
38.10 Let (VM, d) be a metric space. Let d' and d" be defined as in Exercise 35.7. 
Let x c mw. Prove that the following are equivalent: 
(a) X is closed in (M, d) 
(b) X is closed in (M, a’). 
(c) X is closed in (M, da"). 
38.11 Let {x,} be a sequence ina metric space M which converges to x. Prove that {x,)n¢P}U {x} 1S 
a closed subset of M. 
38.12 Let fa, 5,]}2., be a sequence of closed intervals such that ja,)< 1 and jb,)< 1 for every positive 
integer n. Prove that { {x, }=-,|x, € [¢,, 5,]} 1S a closed subset of H”. 


=1 


38.13 Let M be a metric space. Prove the following: 
(a) z= Floryc mM. 
(b) x is closed for all x c ws. 
(c)Ifxc yc, then ¥e F. 
(d) yoy=xur forxy,ycmM. 
(ce) If Yis a closed subset of M such that ¥- y, thenye y. 
(f) Ifx c m, then ¥ =. {yy 1s a closed subset of M containing X}. 
38.14 Let {x,} be a sequence ina metric space VM with no convergent subsequence. Prove that 
{x,|” ¢P} 1S a closed subset of M. 


39. Open Sets 


Let (a, b) be an open interval where a and b are in R. If we let c = (a + b)/2 and ¢ = (b — a)/2, we 
may write 


(a, b) = {x ER |d(x, c) = |x — e| < &} 


that is, (a, b) is the set of real numbers x such that the distance between x and c is less than ¢. The 
generalized open interval in a metric space is called an open ball. 


Definition 39.1 Let (/, d) be a metric space. Let e > 0 and let x ¢ ay. We let 
BAx) = {ye M| d(x, y) < e} 


B(x) is called the open ball of radius ¢ centered at x. 


The open ball in R of radius ¢ centered at x is the open interval (x — ¢, x + ¢). An open ball in R? is 
the interior of a disk and an open ball in R? is the interior of a sphere. See Figure 39.1. 


Definition 39.2 Let V/ be a metric space and let_X be a subset of WM. We 


Figure 39.1 


say that X is open if for every x « x, there exists an open ball B,(x) (centered at x) such that Bx) c ¥. 


An open interval (a, 5) in R is open in R, for if x € (a, 6) and we let e = min {b — x, x — a}, then 
(x — e,x + 8) < (a,5) (verify). (We will show in Theorem 39.4 that an open ball in a metric space M is 
always an open subset of M.) 

Let X be a set with the discrete metric. Then every subset of X 1s open. For ify « y and xe y, we 
have B,(x) ¢ Y. 

We can prove a theorem analogous to Theorem 38.4 with the exception that in general {x} is not 
open. 


Theorem 39.3 Let M be a metric space. Then VM and g@ are open subsets of VM. 


Proof. Let xem. Then B(x) ¢ mM (for any ¢ > 0), and thus / is open. 
If @ is not open, there exists x ¢ @ such that B(x) ¢ @ for any e > 0. However x ¢q@, and thus we 
have a contradiction. my 


We next show that open balls are open sets. The proof of this theorem (Theorem 39.4) for R? is 
illustrated in Figure 39.2. 


Theorem 39.4 Let VM be a metric space. Let x ¢ yg and let ¢ > 0. Then the open ball B(x) is an open 
subset of M. 


Proof. Let (M, d) be a metric space. We must show that if ye Bx), there exists 6 > 0 such that 
By) G (x): 

Let ye B(x). Let d = ¢ — d(x, y). Then 6 > 0. (Why?) We will show that By) < B(x). Let ze B,(y). 
Then d(y, z) < 0. Now 


/ wy b=e-d(x,y) 


“es” 
J 
‘ 


f ¥ 


Figure 39.2 


d(x, z) < d(x, y) + d(y, z) 
< d(x,y) +6 


= & 
and hence ze B(x). 


The next theorem gives the relationship between closed and open sets. 


Theorem 39.5 Let MV be a metric space and let x — yg. Then_X is open if and only if.X’ is closed. 


Proof. Let (M, d) be a metric space. Suppose that _X is an open subset of M. Let x be a limit point of 
X". We must show that x ¢ x’. Ifx¢ x’, then x<_ y. Since X is open there exists an open ball B,(x) such 
that B(x) c ¥. Since x is a limit point of X”, there exists a sequence {x,} of points in X” such that 
lim... x, =x. Therefore, there exists a positive integer N such that d(x,, x) < ¢. Now x, € B,(x), and so 
xy € Xo X', which is impossible. Thus x ¢ yx’, and therefore X’ is closed. 

Suppose %” is closed. If X is not open, there exists ,<_y such that for any ¢>0, B(x) ¢ ¥. 
Equivalently, we have B(x) n X’ # @ for every ¢ > 0. For each positive integer n, there exists a point 
x, 1N B,,,(x) 0 X*. Now {x,} is a sequence of points in X’, and since d(x,, x) < 1/n, we have lim,_,,. x, = 
x. Thus x is a limit point of X’ and since X’ is closed, x ¢ x’. This contradiction yields the theorem. gm 


Let X be a set with the discrete metric. In Section 38 we proved that every subset of X is closed. It 
follows from Theorem 39.5 that every subset of X is open. 
The next theorem is analogous to Corollary 38.6 and Theorem 38.8. 


Theorem 39.6 Let M be a metric space. 
(i) IfU,,..., U, are open subsets of M, then y, an U, a---n U, 1S an open subset of M. 
(11) If gy is a collection of open subsets of M, then ,, y 1s an open subset of MW. 


Proof. Let U,, U,,..., U, be open subsets of M. By Theorem 39.5 it is enough to show that 
(U, n---n Uy is closed. By Theorem 39.5, each of U',, U’;,..., U', is closed and by Corollary 38.6, 
UL UUSuUs-u Ui is closed. By Theorem 1.7, (U, n---0 U,Y = Uy Us:+u U;. Thus (G,9°:n uy is 
closed, and hence U, n- ++ U,, 1S open. 

Part (11) is proved similarly using Theorems 38.8 and 1.7. my 


An arbitrary intersection of open sets need not be open. For example, 


is not open in R. 

If a subset of a metric space is not open, this does not mean in general that it is closed. Indeed, 
there are subsets of R which are neither open nor closed. For example, the half-open interval [0, 1) is 
neither open nor closed in R. 

If X is a set and g is a collection of subsets of X satisfying 
GQ) X%,GeF 
(11) The union of a subcollection of g is a member of x 
(111) The intersection of a finite subcollection of g is a member of g then g is called a topology for 
X. By Theorems 39.3 and 39.6, the collection of open subsets of a metric space M is a topology for 
M. 


Exercises 


39.1 Prove that a half-open interval not of the form (— %, b] or [a, ©) is neither closed nor open in 
R. 

39.2 Prove Theorem 39.6 (ii). 

39.3 Deduce Theorem 39.6 from Definition 39.2. 

39.4 Let M be a metric space such that M is a finite set. Prove that every subset of / is open. 

39.5 Prove that the interior of a rectangle in R’ 


{((x, VWla<x<be< y< d} 


is an open subset of R’. 
39.6 Prove that if X and Yare open subsets of R, then_XY x Yis an open subset of R’. State and 
prove a generalization to R". 
39.7 Letfbe a continuous function from R into R. Prove that {2q/(x) > 0} is an open subset of R. 
39.8 LetX be an open, nonempty subset of R. Prove that there exists a unique countable set of open 
intervals {(a,, &,)}2., Such that 
(a) U nb.) =X 
(b) (ans bm) A (Gy by) = @ifn $m (a, =—co and b, = «& may occur) 
39.9 LetX be a subset of a metric space M. Prove that X 1s an open subset of M if and only if X is 
the union of open balls. 
39.10 Let X be a subset of a metric space M. Prove that X is a closed subset of M if and only if 
whenever x is a point in M such that a¢xyn x g@ for every ¢ > 0, then y¢ yx. 
39.11 IfX 1s a subset of a metric space M, we say that a point x in_X is an interior point of X if 
(x ~ e,x + 2) < (a,5) for some e > 0, and we let X° denote the set of interior points of X. 
Let M be a metric space. Prove the following: 


(a)xec x forxyc m. 


(b) X is open if and only if ¥* = x, ¥c M. 

(c) (X°)? = X° for cyaye = ye. 

(d) X° is open for all yc wy. 

(ce) Ifxc vem, then you ye. 

(xn yy = x°n Y°’ for x, ¥c M. 

(g) If Yis an open subset of MV such thaty «¢ xc m, theny« ye. 

(h) Ifx c mw, then yo — VU {¥y|¥c x and Y is open}. 

(i) (X’))' = 2°, for all x c m. 

39.12 IfXis a subset of a metric space M, we define the boundary of X to be the set ay = ¥n(x’)-. 

Let M be a metric space. Prove the following: 

(a) OX is closed for all x, x c mM. 

(b) yoav=X forall xy xc wm. 

(c) X\OX =X° for all x, x c M. 

(d) If X is a proper nonempty subset of R, then OX ¥ @. 


40. Continuous Functions on Metric Spaces 


We will define continuity of a function in an arbitrary metric space analogously to the situation for the 
real line. Guided by Theorem 33.3 we make the following definition. 


Definition 40.1 Let (1Z,, d,) and (/,, d,) be metric spaces, let ge M,, and let f be a function from M, 
into M,. We say that fis continuous at a if for every ¢ > 0, there exists 6 > 0 such that if d,(x, a) < 0, 
then d,(f(x), f(a)) < ¢. We say that fis continuous on M, if fis continuous at every point of VW. 


In case M, = M, = R and d, = d, is the usual metric for R, Definition 40.1 gives exactly the 
definition of continuity for real-valued functions defined on a subset of R (see Theorem 33.3). 
Examples. Let f: /' — R be defined by f({a,},) =a, Let tg32, ef. We will prove that f is 
continuous at every point of /'. Let e > 0 and take 6 = «. If 0 < d({x,}, {a,}) <6, then r@., |x, — a,[, SO 
that |x, -a,) < ©, |x, —@| <= 2, and thus f({x,}) — flia,})) < ¢, and we have established 
continuity. 

Let J: /' > FP be defined by I(x) = x, for x ¢-p. Let {432 ¢. We will prove that / is continuous at 
every point of /'. Let d' and d’ denote the metrics on /' and /’, respectively. It is easy to verify that 
d(x, y) < d(x, y) for xper. Let e > 0. Set 6 = ¢. If 0 < d'(x, {a,}) < 6, then 7(U(x), {a,}) = A(x, 
{a,}) <d'(x, {a,} <0 =e, and we have established continuity. 


Theorem 40.2 Let f be a function from a metric space M, into a metric space M,. Letae m,. Then/ is 
continuous at a if and only if whenever {x,} 1s a sequence in M, such that lim... x, = a, then lim,___. 


Ax,) =f(a). 


Proof. Let (M,, d,) and (M,, d,) be metric spaces, let fbe a function from M, into M,, and let ae M,. 
First, suppose that fis continuous at a. Let {x,} be a sequence in M, such that lim, x, =a. Let e > 


0. There exists 6 > 0 such that if d,(x, a) < 0, then d,(f(x), f(a)) < e. Since lim, _,,. x, =a, there exists a 
positive integer N such that ifn > N, then d,(x,, a) < 0. Ifn = N, then d,(x,, a) < 0, and hence d,(f(x,), 
fla)) <e. 

Now suppose that whenever {x,} 1s a sequence in M, such that lim,_.,. x, = a, then lim, f(x,) = 
f(a). If fis not continuous at a, there exists ¢ > 0 such that for any 6 > 0, d,(x, a) < 6 for some ae M,, 
but d,(f(x), f(a)) = e. Thus for every positive integer n, there exists x, eM, such that 


di(x,, @) < - and =s d,( f(x,), f(a) = 8 


Now, lim, ,,. x, =a, but lim, f(x,,) # f(a), and we have a contradiction. my 


The equation lim, ,,, f(x,) = f(a) in Theorem 40.2 can also be written lim,_,., fx,) = /(lim,_..,. x,) 
(since lim, .,. x, =a). Thus fis continuous at a if and only if “lim” and “f” can be interchanged. Many 
problems in analysis reduce to showing that “lim” may be interchanged with some other symbol. 
Inevitably there is a question of continuity lurking in the background. 

Of particular importance are continuous real-valued functions on metric spaces. [Of course, when 
we Say that fis a continuous real-valued function on a metric space M, we mean that fis a continuous 
function from M into R, where the metric on R is the usual (absolute value) metric.] Clearly any 
constant function is continuous on a metric space. The next theorem shows that there are nonconstant 
continuous real-valued functions on any metric space with more than one point. (See Exercise 40.14 
for a related result.) 


Theorem 40.3 Let (M, d) be a metric space and let ge yy. The function f defined by the equation 
f(x) = d(x, a) 
is a continuous real-valued function on VM. Moreover, f(x) = 0 if and only ifx =a. 
Proof. Let e > 0. Let 6 = &. Suppose d(x, y) < 6. Then 


d(x, a) <= d(x, y) + dy, a) 


SO f(x) — fO) = d(x, a) — d(y, a) < d(x, y) 
Similar] 

imilarly fy) — f0) < d(x, y) 
Therefore 


f(x) — f(y) s d(x, y) <b =e 
Since fis continuous at every point of M/, fis continuous on M. 


f(x) = 0 if and only if d(x, a) = 0, which by Definition 35.1 occurs if and only ifx =a. q 


Theorem 40.3 is often summarized by stating that the distance function (or metric) is a continuous 
function. 

Our next theorem is analogous to a theorem (Theorem 33.2) about continuous real-valued functions 
on R. 


Theorem 40.4 Let fand g be continuous real-valued functions on a metric space M. Then 
(1) fj is continuous on M. 
(11) f + gis continuous on M. 
(111) cf 1s continuous on M for each cer. 
(iv) f— gis continuous on M. 
(v) fg is continuous on /. 
(vi) f/g is continuous on M if g(x) #0 for every xe a. 


Proof. We prove only part (11). The proofs of the other parts are similar and are left as exercises. 

Let gem. Let {x,} be a sequence in M such that lim, |, x, =a. Since fand g are continuous at a, by 
Theorem 40.2, lim, fx,) = f(a) and lim, g(,) = g(a). Now {f(x,)} and {g(x,)} are real 
sequences; so by Theorem 12.2, lim... [f(x,) + g(x,)] =f(a) + g(a). By Theorem 40.2, f + g is 
continuous at a for every ge M- m 


We return now to arbitrary continuous functions on metric spaces. We first characterize continuity 
in terms of open and closed sets. 


Theorem 40.5 Let f be a function from a metric space M, into a metric space M,. The following are 
equivalent: 

(1) fis continuous on M,. 

(ii) f '(C) is closed whenever C is a closed subset of M,,. 

(iii) f'(U) is open whenever U is an open subset of M,. 


Proof. (i) implies (11). Suppose that fis continuous on M,, and let C be a closed subset of M,. To 
show that f'(C) is closed, we must show that f'(C) contains its limit points. 

Let a be a limit point of f'(C). Then there exists a sequence {x,} in f''(C) such that lim, x, =a. 
Since fis continuous at a, lim, ,.. f(x,) =/(a). Now xe f-*(c) for every positive integer n, and hence 
f(x, ec for every positive integer n. Therefore, f(a) is a limit point of C, and since C is closed, 
f(a) « C. But this means that ge f-1(¢), and thus f'(C) is closed. 

(11) implies (111). Let U be an open subset of M,. By Theorem 39.5, U’ is closed. By hypothesis, / 
~'(U’) is closed. Since f''(U’) = f'(U)]’, [fF '(U)]' is closed. By Theorem 39.5, [f''(U)]" = f'(U) is 
open. 

(iii) implies (i). Suppose now that f'(U) is open whenever U is an open subset of M,. We will 
prove that fis continuous on M, directly from the definition of continuity (Definition 40.1). 

Let d, and d, be the metrics for MV, and M,, respectively. Let ae M, and let ¢ > 0. By Theorem 39.4, 
B(f(a)) is an open subset of M,, and so f'(B,(f(a))) is open in M,. Since ae f-*(B,(f(a))). there exists 
0 > 0 such that Ba) < f-*(B,(f(a)))- If d(x, a) < 0, then x € B,(a), and hence x ef-*(#,(f(a))). Therefore, 
f(x)_B(f(@), but this means that d,(f(x), f(a)) < e. Thus fis continuous at a for everyae My. m 


Let X be a set with the discrete metric and let M be a metric space. We will show that every 
function f from_X into M is continuous. For if Uis open in M, f''(U) is open in_X since every subset of 
X is open (see Section 39). 


Corollary 40.6 Let M,, M,, and M, be metric spaces, and suppose that g is a continuous function from 


M, into M, and that fis a continuous function from M, into M,. Then f° g is a continuous function 
from M, into M,. 


Proof. By Theorem 40.5, it is enough to show that (f° g) '(U) is open whenever U is an open 
subset of M,. Let U be open in M,. By Theorem 40.5, f'(U) is open in M,. Again by Theorem 40.5, g 


“'(f'(U)) is open in M,. Since (f° g) '(U) =g '(f'(U)), we have the desired result. my 


Corollary 40.6 can be summarized by stating that the composition of continuous functions is 
continuous. 


Exercises 


40.1 
40.2 
40.3 
40.4 
40.5 
40.6 


40.7 


40.8 


40.9 


Prove Theorem 40.4(1), (111), (iv), (v), and (v1). 

Prove Theorem 40.4 using Definition 40.1. 

Prove that Theorem 40.5(1) implies Theorem 40.5(i11) using Definition 40.1. 

Prove Corollary 40.6 using Theorem 40.2. 

Prove Corollary 40.6 using Definition 40.1. 

Let M, and M, be metric spaces and let f(x) = c. Let f(x) = c for all xe ,. Prove that fis 

continuous on M/,. 

Let fbe a function from a metric space (M,, d,) into a metric space (M,, d,). Letae M,. Prove 

that the following are equivalent. 

(a) fis continuous at a. 

(b) If Uis an open subset of VM, which contains f(a), there exists an open subset V of M, 
which contains a such that y ¢ f-1(U). 

Let fand g be continuous functions from R into R. Prove that h(x) = (f(x), g(x)) defines a 

continuous function from R into R’. State and prove generalizations involving continuous 

functions from R” into R”. 

Let k be a positive integer. If {a,} 1s a real sequence, let p,({a,}) =a,. Prove that p, is a 

continuous real-valued function on any of the spaces /', I’, c,, /”, or H”. 


40.10 Let ia} ez. Prove that f defined by 


f({bu}) = 3 ub 


is a continuous real-valued function on /'. 


40.11 Lets} e2. Prove that f defined by 


f({bu}) = ¥ ands 


is a continuous real-valued function on 7’. 


40.12 Let (M, d) be a metric space. Let M x M be the product metric space (see Exercise 35.8). 


Prove that d is a continuous real-valued function on M x M. 


40.13. Letaand b be real numbers. Prove that 


max {a,6}—2tb +a? 


and sail 
min {a, b) = 2+ Sla— Fl 


If f and g are real-valued functions on a set X, we define 
Imax {f, g}](x) = max (f(x), g@)} for xe X 


d 
= [min {f, g}(x) = min (f(x), g@)} for xe X 


Let f and g be continuous real-valued functions on a metric space M. Prove that max {f, g} 
and min {f, g} are continuous real-valued functions on M. 
40.14 Let (MV, d) be a metric space and let_X be a subset of M. If xe az, we define 


d(x, X) = glb {d(x, ly ¢ X} 


(a) Prove that f(x) = d(x, X) defines a continuous real-valued function on M. 
(b) Prove that f(x) = 0 if and only if ye z. 
(c) Let A and B be closed subsets of M such that 4a B= g. Let 


ms d(x, A) 
OX) = TA) + dw 


Prove that g is a continuous function from / into [0, 1] such that 


, {0 ifxed 
as) = {1 ifxeB 


(d)° Let A and B be closed subsets of M such that 4n B= q@. Prove that there exist open 
subsets U and V of M such that 4c u,Bce vy, andUnV=@. 
40.15 Let fbe a real-valued function on a metric space M. Prove that fis continuous on M if and 
only if the sets 


({x]f@)<e} — {x[/fG) > c} 


are open in UY for every c inR. 

40.16 Let (MM, d) be a metric space such that d(x, y) < 1 for all x, ye m, and let {a,} be a sequence 
of points in M. Set fox = {a(x, a,)}, fOr xe M- 

(a) Prove that fis a continuous function from M into H”. 
(b)° Prove that if fa,|”¢P}- = M, then fis one-to-one. 

40.17 Let bea set and let d and a’ be metrics for M. We say that d and d' are equivalent metrics 
for M if the collection of open subsets of (M, d) is identical with the collection of open 
subsets of (MV, a’). 

(a) Prove that the following are equivalent. 
(1) d and d’ are equivalent metrics. 


(11) The collection of closed subsets of (M, d) is identical with the collection of closed 
subsets of (MV, a’). 
(111) The sequence {x,,} converges in (MV, d) if and only if {x,} converges in (M, a’). 
(b) Prove that the metrics d, d', and d" of Exercise 35.7 are equivalent. 


(c) Prove that the metric d’ of Exercise 37.9 is equivalent to the usual (Euclidean) metric on 
R’. 


41. The Relative Metric 


Let R have the usual metric, d(x, vy) = — y. Since [0, 1] is a subset of R, we can regard [0, 1] as a 
metric space by restricting the metric d to [0, 1]. Thus the metric d' for [0, 1] is given by 


ax, y)=|x—yl for x, ye[0, 1] 


We will use the notation gt¢.13/,) to denote the open ball of radius ¢ centered at x in the metric space 
([0, 1], d’). For example, 


Bin G@=GH BY? ©) = [0,4 


By Theorem 39.4, an open ball is an open set, and therefore (3, 3) and [0, 4) are open sets in the metric 
space ([0, 1], d’). We must be careful to specify the metric space in which we are working, for [0, 4) is 
not open in the metric space (R, d). Notice that the open ball s{%;'%0) = [0, 3) (in [0, 1]) is simply the 
open ball g%,,.@) = (—4, ) (in R) “cut down” to [0, 1]. More precisely, we have 


BY) 0) = BYy2 (0) 0 [0, 1) 


It is easy to see that this will always be the case. The open ball gt-t) (in ([0, 1]) is simply 
B¥(x) 7 [0, 1]. We know that open balls in R are open intervals; hence the open balls in [0, 1] are 
simply open intervals intersected with [0, 1]. We now analyze this situation in an arbitrary metric 
space. 


Definition 41.1 Let (V, d) be a metric space and let _X be a subset of /. The function d’ defined by 
d'(x,y)=d(x,y) for x,yeXx 


is called the metric for X relative to M or more simply, the relative metric for X. 

If_X is a subset of a metric space M and we wish to regard X as a metric space, we will always use 
the relative metric of Definition 41.1 for X. We will refer to _X as a relative metric space. 

Keeping the notation of Definition 41.1, an open ball in_X of radius ¢ centered at a is the set 


{xe X | d’ (x, a) < &} 
which we denote g*(g). Letting 


Ba) = {xe M | d(x, a) < 8} 


be the open ball in M of radius ¢ centered at a, we see that 


B*(a) = B{a) \ X (41.1) 


(Verify.) A relationship like that given in equation (41.1) also holds for open and closed sets as the 
next theorem shows. 


Theorem 41.2 Let M be a metric space and let_X be a subset of M with the relative metric. Let Ybe a 
subset of X. 


(i) Yis open in_X if and only ify = xq uy, where U is openin M. 
(11) Yis closed in X if and only ify = xn c, where Cis closed in M. 


Proof. Suppose Yis open in_X. Then for every xe y, there exists ¢, > 0 such that 
BE) -& 


Let U=() Be) 
weY 


Then U is open in M and 
KnU=Xn(\) B,)) 
xoY 
= U (X 0 B(x) 
U Be) 
xeY 
=Y 


Next suppose that Y is a subset of X such that y = yn y, where U is open in M. Let xe y. Then 
xe uy and since U is open in M, there exists ¢ > 0 such that a(x) < u. Now 


Bix) = BIN XcUKK=Y¥ 


and thus Yis open in_X. We have established part (1) of the theorem. 

Suppose Y is closed in X. Let C = y, where the closure is taken in M. Then C 1s closed in M. 
Clearly, yc xnc. Letxexnc. Since ,._ yf, there exists a sequence {x,} in Y such that lim, |. x, = 
x. Since x _ y 1S a limit point (in_X) of Y. Since Yis closed in xy, xe y. Thus yqnc ae ¥. 

Finally, suppose that Y1is a subset of X such that y = ¥ nq c, where C is closed in M. Let x be a limit 
point (in_X) of Y. Then there exists a sequence {x,} in Y such that lim, ... x, =x. Now {x,} is also in 


C, and hence x is a limit point of C, and since C is closed, xec. Thus xe ¥nC = Y, and so Y is 
closed inX. gy 


Corollary 41.3 (1) Let_X be an open subset of a metric space M and let y — y. Then Y is open in X if 
and only if Yis open in M. 

(11) Let _X be a closed subset of a metric space M and let y e y. Then Y 1s closed in_X 1f and only if 
Yis closed in M. 


Proof. Let X be an open subset of M and let ye y. If Y is open in M, then Y is open in _X by 
Theorem 41.2 (1) since y = x, y. Now suppose that Yis open in_X. By Theorem 41.2 (1), there exists 
a set U open in M such that y = xn y. Since X and U are open in ¥, xn U is open in M [Theorem 
39.6 (i)]. 

Part (11) is proved similarly. m 


Exercises 


41.1 Deduce Theorem 41.2(11) from Theorem 41.2(1) using Theorem 39.5. 
41.2 Prove Corollary 41.3(i1). 
41.3 LetA=[0, 1],2=G,1,c=@Q»BD. 
(a) Is B open (closed) in A? 
(b) Is C open (closed) in A? 
(c) Is A open (closed) in R? 
(d) Is C open (closed) in R? 
(e) Is_A open (closed) in R*? 
(f) Is C open (closed) in R?? 
(g) Is R open (closed) in R*? 
41.4 Let M bea metric space and let X be a subset of / with the relative metric. Prove that if fis 
a continuous function on M, then fX is a continuous function omX. 
41.5 Let Mbe a metric space and let _X be a subset of / with the relative metric. If Yis a subset of 
X, let Y™ denote the closure of Yin the metric space X. Prove that y-~ — y- , x. State and 
prove a corresponding result for Y°. 


42. Compact Metric Spaces 


We recall (Theorem 34.2) that a closed interval [a, b] of the real line has the following property. If g 
is a collection of open intervals such that [a, 5} a, %, then there exists a finite subcollection {U,, U,, . 
.., U} of y such that [a,b] ¢ U,U U,U-++U U,. We now generalize this property to arbitrary metric 
spaces. “Open interval” is replaced by “open set.” 


Definition 42.1 An open cover of a metric space M is a collection g of open subsets of M such that 
mM =u %. Asubcover of g is a subcollection g* of g such that yy = vy ay*. 


Definition 42.2 A metric space M is said to be compact if every open cover of M has a finite 
subcover. 


In other words a metric space M is compact if whenever gy is a collection of open subsets of 
such that yg = u », there exist U,, U,,..., U, in g such that yy = U, UU, U+:-U U,. The crucial part 
of the definition is that we must be able to reduce every open cover to a finite subcover. 


Examples. Let / be a finite metric space. Then every open cover g 1s finite in the first place, and 
therefore M/ is compact. 


Let X be a set with the discrete metric. If X is finite, then_X is compact. 
However, if _X is infinite XY is not compact, since the open cover 


UH = {{x}|xeX} 


has no finite subcover. 
The open interval (0, 1) (with the relative metric) is not compact since the open cover 


*o ile) 


has no finite subcover (verify). [The sets (1/n, 1) are open in (0, 1) by Corollary 41.3 (1).] 
The space R is not compact since the open cover 


nePn>= 2h 


{(—n, n) | ne P} 


has no finite subcover. Ina similar way, one can show that R”, /', /?, cy, and /” are not compact. 
The Heine-Borel theorem (Theorem 34.2) is virtually the statement that a closed interval [a, b] is 
compact. We must only sort out the relative metric. 


Theorem 42.3 A closed interval [a, b] 1s compact. 
Proof. Let gm be an open cover of [a, 5]. Then for every x in [a, b], there exists an open set U, in gy 
such that x ¢ u,. Since U, is open, there exists an open ball (in [a, b]) B&"x) < U,. Now the collection 


B® = {BE (x) | xe [a, b]} 


is a family of open intervals such that [¢, 6} ¢ u @. By Theorem 34.2, there exist x,,..., x,¢[a, 6] such 
that 


fab] UY) BE) 


Now Ia, B] = U (a, B) 0 BR (x) = U BEM x) U o. 


i 


Therefore [a, 6] = ()?-, U,, and hence [a, b] is compact. m 


We now imitate the proof of Theorem 34.3, which is concerned with the compact space [a, b], to 
prove that a continuous function on a compact metric space attains a maximum and a minimum. 


Definition 42.4 Let f be a real-valued function on a set X. We say that fis bounded on X if there 
exists a number M such that f(x)| < M for every xe x. 


Lemma 42.5 Let f be a real-valued function on a metric space M. If fis continuous at a, there exists 
an open set U containing a such that fis bounded on U. 


Proof. Let (M, d) be a metric space. 


Taking ¢ = 1, there exists 6 > 0 such that if d(x, a) < 6, then f(x) — f(a), < 1. Thus ifx is in the open set 
B;(a), we have 


FOO = If) — f@ + [/@) < 1 + 17! “a 


Theorem 42.6 If f is a continuous real-valued function on a compact metric space M, then f is 
bounded on M. 


Proof. By Lemma 42.5, for each ge jy there exists an open set U, containing a such that f is 
bounded on U,. Now {U,|a@eM} iS an open cover of M, and since M is compact, there exists 
a;,..-, 4a, M such that 


M = U,,UU,,U-+-U U,, 
Since fis bounded on u,, for 1 <i <n, fis bounded onU,, U---u U,, =. 


Corollary 42.7 If fis a continuous real-valued function on a compact metric space M, there exist 
c,de M such that f(c) < f(x) < fd) for all x ¢ yz. That is, fattains a maximum and a minimum on M. 


Proof. By Theorem 42.6, fis bounded, and hence the least upper bound 7 of the set 
X = {f(x)|xeM} 


exists. We must show that f(d) = T for some ge y. If this fails, f(x) < T for all xe 4g. By Theorem 
40.4, g(x) = 1/(T — f(x)) is a continuous function on VM. By Theorem 42.6, g is bounded. Suppose g(x) 
<S for all x in M. Then f(x) < T— 1/S < T for all x in M. This contradicts the assumption that 7’ = lub 
X. 

Similarly, f attains a minimum on VM. gy 


Exercises 


42.1 Prove that none of the spaces R", /', 7, cy, or /” is compact. 

42.2" Let.X be a compact subset of a metric space M. Prove that_X is closed. 

42.3 LetX,,...,X, bea finite collection of compact subsets of a metric space M. Prove that 
X,uX,u---u X¥, 1S a compact metric space. Show (by example) that this result does not 
generalize to infinite unions. 

42.4 Let ¢beacollection of compact subsets of a metric space. Prove that , ¢ 1s compact. 

42.5 Acollection ¢g of subsets of a set_X is said to have the finite intersection property if 
whenever {C;,..., C,} is a finite subcollection of ¢g, we have c, aC, n---n¢, + @. Prove that 
a metric space M is compact if and only if whenever ¢ 1s a collection of closed subsets of M 
having the finite intersection property, we have n ¢ # @. 

42.6 Let fbea continuous real-valued function on a compact metric space M. Suppose that f(x) > 0 
for all x ¢ ag. Prove that there exists 7’ > 0 such that f(x) > T for all xe 4. 

42.7 LetX be a compact subset of R and let yer. Prove that the set {x +- y[x ¢ x} 18 Compact. 

42.8 Let fbe a continuous, real-valued function on a metric space M which is never zero. Prove 


that the collection of open sets U for which either f(x) > 0 for y¢ y or f(x) < 0 for ye yis an 
open cover of M. 

42.9 Call an open cover gy of a metric space M an additive cover if whenever u, Vex, we have 
U, Ve. Prove that VM is compact if and only if every additive open cover of M contains M 
(Johnsonbaugh, 1977). 

42.10 Let {X,} be a sequence of compact subsets of a metric space M with x, > xX, > x3 3-+-. 
Prove that if U is an open set containing p.x,, then there exists x, ¢ u. 

42.11 Let fbe a function on [a, 5]. Let K be a compact subset of [a, 5] on which fis continuous. 
Suppose there exists c > 0 such that for each xex, there exists h, > 0 with 


atid £09) < 
he 


Prove that there exists a finite subset {x,,..., x,} ¢ K and positive numbers /,,...,, such 
that 
(a) x, <x, +h, <x, <x, +h, Sx,<-°: 


(b) [At Ao FO! < - fori=l,... 50 


(c)Kc Ube, x + Ad 
42.12" A contractive mapping on M is a function f from the metric space (M, d) into itself 
satisfying 
d( f(x), FO) < dy, y) 


whenever x, ye mM withx #y. Prove that if fis a contractive mapping on a compact metric 
space M, there exists a unique point x ¢ yg with f(x) =x. (Such a point 1s called a fixed point.) 


43. The Bolzano-Weierstrass Characterization of a Compact Metric Space 


The Bolzano-Weierstrass theorem (Theorem 18.1) states that every bounded real sequence has a 
convergent subsequence. We will prove (Theorem 43.5) that a metric space M is compact if and only 
if every sequence in M has a convergent subsequence. The proof is divided into four lemmas. 


Lemma 43.1 If M is a compact metric space, then every sequence in M has a convergent 
subsequence. 


Proof. Suppose there exists a sequence {x,} in M which has no convergent subsequence. We claim 
that for every x ¢ yy, there exists an open ball B(x) such that the set 


{ne P| x, € Bx} 


is finite. For if some x ¢ yg has the property that every open ball 5.(x) contains x, for infinitely many 
positive integers n, we may produce a convergent subsequence of {x,} as follows. Choose x,, ¢ B,(x). 


Choose x,, ¢ B,(x) such that n, > n,. Having chosen x,, ¢ Byy(x), choose x,, ., € Byjes1)(*) Such that n,,, > 


n,. Then lim, X,, = x, and hence {x,,}{2, 1S a convergent subsequence of {x,}. This is a contradiction, 
and hence for every x ¢ wf, there exists an open ball 2, (x) such that the set 


{ne P| x, € BC} 


is finite. 
Now % = {B,(x)| x¢M} 1s an open cover of M. No finite subcollection of g% covers M, for 
otherwise the set 


{ne P|x,¢M} 


is finite, which is impossible. This contradicts the definition of compactness and we have the desired 
conclusion. gy 


Let M be a metric space in which every sequence has a convergent subsequence. To prove the 
converse of Lemma 43.1, we must show that every open cover of M has a finite subcover. Let ¢ > 0. 
We first show that the special open cover 


U = {B(x)|xe M} 
has a finite subcover. 


Lemma 43.2 Let / be a metric space in which every sequence has a convergent subsequence. Let ¢ > 
0. Then there exist x,,..., x, ¢M@ such that 


M= BAX) Nace BAx,) 


Proof. Let d denote the metric on M. Let x,e mM. If B(x,) = M, we stop. Otherwise, there exists 
x;€M\(B(x,)v, and thus d(x,, x,) = ¢. If M= Bx,) U B{x,), we stop. Otherwise, there exists 
x; € M\(B(x,) UB,{(x,)), and thus d(x,, x,) = ¢ and d(x,, x,) = ¢. This process must stop after a finite 
number of steps, for otherwise we obtain a sequence {x,} in M such that 


a(x, XxX, ze ifnaszm 


Such a sequence cannot have a convergent subsequence (verify). my 


Let M be a metric space in which every sequence has a convergent subsequence, and let g be an 
open cover of M. If for some ¢ > 0, each open ball B,(x) were contained in some y ¢ y, then M would 
be compact. For 


M = BYx,) v---U Bx,) 
by Lemma 43.2 and since B.(x,) is contained in U, for some U,e %, i =1,..., ”, we would have 
M = B&x,) U---U B(x,) c Uy Ue OU, 


in which case M would be compact. Our next lemma shows that such an ¢ exists. The proof of Lemma 


43.3 is illustrated in Figure 43.1. 


Lemma 43.3 Let / be a metric space in which every sequence has a con- 


8 (x 
in, ao! 


Figure 43.1 


vergent subsequence. If gy is an open cover of M, there exists ¢ > 0 such that if xe, B(x) ¢ U for 
Some Uc y. 


Proof. Suppose the conclusion is false. Then for every ¢ > 0, there exists x ¢ y¢ such that B(x) ¢ U 
for any y¢ y. Taking ¢ = 1/n, there exists x, ¢ @ such that B,,,(x,) ¢ U for any y¢y. By our hypothesis, 
{x,} has a convergent subsequence {x,,}, and we suppose lim,.,, x, = x. Now xe y for some yey, 
and since U is open, there exists ¢ > 0 such that B(x) <c u. Choose a positive integer & such that 


d(x. 


Bh? 


1 
x} < 22 and = te ef2 
k 


where d denotes the metric for M. We will show that 3,,,,(x,,) ¢ U which will be a contradiction. 
Suppose ye B,,,,(x,,). Then d(y, x,,) < 1fn,. Now 


1 @ 8 
d(y, x) = dy, Xy,) + d(x,,, x) < pape we Ee <-+r = E& 
. Ny Zz 2 


Thus ye B,(x), and hence pe U. m 


Lemma 43.4 If M is a metric space in which every sequence has a convergent subsequence, then M is 
compact. 


Proof. Let y be an open cover of M. By Lemma 43.3, there exists ¢ > 0 such that if xe M, B(x) c U 
for some yey. By Lemma 43.2, there exists x,,..., x, ¢ 4 such that 


M = B&x,) U-+-U BO) 


For eachi, 1 <i <n, choose U;¢ @ such that B(x) < u,. Then 
M= BAX;) eT B(x) S U, te | U, 
and hence {U,,..., U,} is a finite subcover of gy, and therefore Mis compact. m 


Theorem 43.5 Let M be a metric space. Then M is compact if and only if every sequence in M has a 
convergent subsequence. 


Proof. The theorem restates Lemmas 43.1 and 43.4. my 


We can use Theorem 43.5 to give another proof of the Bolzano-Weierstrass theorem (Theorem 
18.1). Let {a,} be a bounded real sequence. Then {a,} is contained in an interval [a, b]. By Theorem 
42.3 [a, b] is compact, and thus {a,} has a convergent subsequence by Theorem 43.5. 

We close this section by identifying the compact subsets of R” (Theorem 43.8). 


Definition 43.6 A subset S of a metric space (VM, d) is bounded if there exists a number 4 such that 
d(x, y) <A for all xyes. 


Theorem 43.7 If C is a compact subset of a metric space M, then C is closed and bounded (in /). 


Proof. Let d denote the metric on M. Let x ¢ yg. Then 
UM = {B(x)|neP} 


is an open cover of C and hence some finite subcollection {86 (x), ... ,BS(x)} of @ covers C. Let N = 
max {n,,...,n,}. Ify,zec, then d(y, z) < 2N, and therefore C is bounded. 

Let x be a limit point of C. Then there exists a sequence {x,} in C such that lim, x, =x. Since C 
is compact, the sequence {x,} has a subsequence {x,,} which converges to a point y in C (Theorem 


43.5). But now x = lim,..,, x, = lim,., x, = ye C, and therefore C is closed. m 


ke 


The converse of Theorem 43.7 holds for R”, as we will show next, but the converse does not hold 
in general. Let 0 denote the sequence {a,}, where a, = 0 for every positive integer n. Let 


X = {xel' | d(x, 0) = 1} 


By Theorem 40.4, f(x) = d(x, 0) is continuous and by Theorem 40.6 f''(1) =X is closed. Obviously X 
is bounded. However, X is not compact. The sequence {6“! (defined in Section 37) has no 
convergent subsequence for if {0} had a convergent subsequence 45}, by Theorem 37.3 
would converge to 0, and we have already noted (Section 37) that this is not the case. 


Theorem 43.8 Let C be a closed subset of a compact metric space M. Then C is compact. 


Proof. If {x,} 1S a sequence in C, {x,} has a subsequence {x,,} which converges to a point x in M, 
since M is compact. But x is a limit point of C, and since C 1s closed, y¢-¢. By Theorem 43.5, C is 
compact. gy 


Theorem 43.9 A subset_X of R” is compact if and only if _X is closed and bounded. 


Proof. Let X be a closed and bounded subset of R", and let sg} , be a sequence in_X. Since X is 
bounded, the real sequence {g}@ , is bounded and thus has a convergent subsequence {a(*)}2 ,. The 
real sequence {af} , is bounded and thus has a convergent subsequence {gis)}2 ,. Now {af}2 , 1s a 
subsequence of the convergent sequence {a‘*)}~, and thus converges. We continue in this way 
producing a subsequence {4®}~ , of fa}2 , such that {6}2 , converges for 7 =1,..., 7. By Theorem 
37.2, {6}© , converges to a point a of R”. Since X is closed, ae x, and by Theorem 43.5, X is 
compact. 


The converse follows from Theorem 43.7. gm 


Corollary 43.10 If fis a continuous real-valued function on a closed and bounded subset_X of R", then 
f attains a maximum and a minimum onx. 


Proof. Combine Corollary 42.7 and Theorem 43.9. my 
Exercises 


43.1 Prove that the set {x ¢ M] d(x, 0) = 1} is closed and bounded in M, but not compact if M is 1’, c, 
or /”. 

43.2 Let M, and M, be compact metric spaces. Prove that the product metric space M, =< M, is 
compact. 

43.3 “ Let M be a metric space. If there exists a countable subset X of M such that x = M, M is said 
to be separable. 
Prove that a compact metric space 1s separable. 

43.4 If(M, d) is a bounded metric space, we let diam = Ib {a(x, y)| x, y edt}. Prove that if (VM, d) 
is a compact metric space, there exist x, ye a4 Such that d(x, y) = diam M. 

43.5 IfX is a compact subset of R, describe’. 

43.6 Prove that H” is a compact metric space. 

43.7 LetX be a compact subset of a metric space M. If ye x’, prove that there exists a point ge x 
such that 


d(a,y) <d(x,y) forallxeX 


Give an example to show that the conclusion may fail if “compact” is replaced by “closed.” 


44, Continuous Functions on Compact Metric Spaces 


Continuous functions on compact metric spaces have many nice properties. We have already proved 
(Corollary 42.7) that a continuous real-valued function on a compact metric space attains a maximum 
and a minimum. In this section we will derive further results. 


Theorem 44.1 If fis a continuous function from a compact metric space M, into a metric space M,, 
then /(/,) 1s compact. 


Proof. Let {f(x,,)} be a sequence in f(M,). Then {x,} 1s a sequence in M,, and since M, is compact, 
{x,} has a subsequence {x,,} which converges to a in M, (Theorem 43.5). Since f'is continuous at a, 


lim. f(%,,) = f(a). Therefore {/(x,,)} 18 a convergent subsequence of {f(x,)} in M,. By Theorem 43.5, 
f(M,) is compact. my 


Corollary 44.2 If fis a continuous function from a compact metric space M, into a metric space M,, 
then /(/,) is closed and bounded. 


Proof. The proof follows immediately from Theorems 43.7 and 44.1. m 


The next theorem shows that a one-to-one continuous function on a compact metric space has a 
continuous inverse. 


Theorem 44.3 If fis a one-to-one continuous function from a compact metric space M, onto a metric 
space M,, then f' is continuous on M,. 


Proof. By Theorem 40.6, we must show that if C is a closed subset of M,, then (f')'(C) =/(C) is a 
closed subset of M/,. 

Let C be a closed subset of M,. Then C is compact by Theorem 43.8. By Corollary 44.2, f(C) is 
closed in V,. 


Example. Let 1 be a positive integer and let f(x) = x", x = 0. In Section 33, we showed that f is 
continuous. Let a > 0. Then fis a continuous function from [0, a] onto [0, a”]. Now f'(x) =x", and by 
Theorem 44.3, f' is a continuous function from [0, a”] onto [0, a] for every a > 0. Therefore f'(x) = 
x!" is continuous on [0, ©). Ifn is an odd positive integer, the argument can be modified to show that f 
(x) = x!" is continuous on R. 

Let fbe a continuous function from a metric space (M,, d,) into a metric space (M,, d,). Let e > 0. 
For each ye M,, there exists 0 > 0 such that if d,(x, vy) < 0, then d,(f(x), fv) < «. In general, 6 will 
depend upon y. However if there exists 0 > 0 which is independent of y, we say that fis uniformly 
continuous on M. 


Definition 44.4 Let (/,, d,) and (M,, d,) be metric spaces, and let f be a function from M, into M,,. 
We say that fis uniformly continuous on M, if for every ¢ > 0, there exists 6 > 0 such that if d,(x, y) < 


6, then d,(f(x), fly) <e. 


Examples. The function f(x) = x 1s uniformly continuous on R for if ¢ > 0 we may take 6 =e. Ifp — y 
< 0d, then f(x) — f= pe - <6 =e. 

The function f(x) = x* is not uniformly continuous on R. We will show that for ¢ = 1, there is no 6 
such that iff — yj < 0, then f(x) — f(y) < 1. 
For suppose such a o exists. Choose a positive integer 1 such that 


2/6 — 6/2 
We MSE 


Letx =n + 0/2, y =n. Thenp — y= 0/2 < 06. But p? —yy=(% — yx + y) = (0/2)(2n + 6/2) > 1. 
Therefore fis not uniformly continuous on R. 
We will show that a continuous function on a compact metric space is uniformly continuous. 


Theorem 44.5 If fis a continuous function from a compact metric space M, into a metric space M,, 
then fis uniformly continuous on M,. 


Proof. Let fbe a continuous function from a compact metric space (M,, d,) into a metric space (WM, 
d,). Lete > 0. For each ze M,, there exists 6, > 0 such that if d(x, z) < 0,, then d,(f(x), f(z)) < e/2. The 
collection 


{Bs {z)|z¢ My} 


is an open cover of M,. By Lemma 43.3, there exists 6 > 0 such that for any xe M,, Bs(x) © Bg,(z) for 
some ze M,. 

Suppose d(x, vy) < 0. Now B,(x) < B;,(z) for some z € M,. Since x.y €.B x), we have x,y « B; (z). Thus 
d(x, z) < 0, and d,(y, z) < 6,, and therefore d,(f(x), f(z)) < ¢/2 and d,(f(v), f(z)) < 6/2. Therefore, if 
d(x, y) < 0, then 


d({@).fO) < 4A f0fQ)+ GOS <Z+5=2 O 


Corollary 44.6 If fis a continuous real-valued function on a closed and bounded subset _X of R”, then 
fis uniformly continuous on x. 


Proof. Use Theorems 43.9 and 44.5. my 
Exercises 


44.1. Give an example of metric spaces M/, and M, and a continuous function f from M, onto M, 
such that M, is compact, but /, is not compact. 

44.2 (a) Prove that f¢) = ./x is uniformly continuous on [0, 0). 
(b) Prove that f(x) =x? is not uniformly continuous on R. 

44.3 Let fand g be uniformly continuous real-valued functions on a metric space, M. Let cer. 
Prove that cf and f+ g are uniformly continuous on M. 

44.4 Let fbea function from R into a set _X. We say that fis periodic if there exists p > 0 such that 
Kx + p) =x) for all x er. Prove that if fis a continuous periodic function from R into a 
metric space M, then fis uniformly continuous on R. 

44.5 Let M,, M,, and M, be metric spaces. Let g be a uniformly continuous function from M, into 
M,, and let f be a uniformly continuous function from M, into M,. Prove that f° g is uniformly 
continuous on M,. 

44.6 Let fbe a one-to-one function froma metric space M, onto a metric space M,. If fand f' are 
continuous, we say that fis a homeomorphism and that M, and M, are homeomorphic metric 
spaces. 


44.7 


44.8 


(a) Prove that any two closed intervals of R are homeomorphic. 

(b) Prove (a) with “closed” replaced by “open”; with “closed” replaced by “half-open.” 

(c) Prove that a closed interval is not homeomorphic to either an open interval or a half-open 
interval. 

(d) Let M be a metric space, and let G(M) denote the set of homeomorphisms of M onto M. 
(1) Prove that G(M) is a group under composition. 
(11) Identify the group G(M) in case M is finite. 
(111) Prove that if M@, and M, are homeomorphic metric spaces, then G(M/,) is isomorphic 

to G(M,). 

(iv) Show, by example, that the converse of (111) does not hold. 

(e)° Prove that any metric space M is homeomorphic to a metric space (M", d) where d is 
bounded by 1. 

(f)" Let M be a separable metric space. Prove that there is a one-to-one, continuous function f 
from M into H”. (Separable is defined in Exercise 43.3.) 

(g)° Prove the following theorem. A metric space M is compact if and only if M is 
homeomorphic to a closed subset of H”. 

” A contraction mapping on M is a function f from the metric space (M, d) into itself 

satisfying 


ACS (x), f(y) < ed&x, y) 


for some c, 0 <c<1 andallx andy in. 
(a) Prove that a contraction mapping on /M is uniformly continuous on M. 
(b) Give an example of a contraction mapping from R onto R. 
(c) Prove that there is no contraction mapping from a compact metric space (with more than 
one point) onto itself, 
Let X be a compact subset of R, and let fbe a real-valued function on_X. Prove that fis 
continuous if and only if (x, f() | xe X} 1s a compact subset of R’. 


45. Connected Metric Spaces 


Under any reasonable definition of connectedness, the metric space y ={0, 1] u [2,3] should not be 
connected. Notice that [0, 1] is open and closed in X (verify) and [0, 1] is neither XY nor g. By 
Theorems 38.4 and 39.3, if Mis a metric space, then VM and g are both open and closed. If these are 
the only subsets of M which are both open and closed, we say that / is connected. 


Definition 45.1 Let / be a metric space. If the only subsets of M/ which are both open and closed are 
M and @, then we say that M 1s connected. 


To prove that a metric space is connected, we often argue by contradiction, and so it is convenient 
to have a characterization of “not connected.” 


Theorem 45.2 Let M be a metric space. The following are equivalent. 


(1) M is not connected. 
(11) There exist open nonempty subsets U and V of M such that yy = yy yandun v= @. 
(111) There exist closed nonempty subsets C and D of M such that y= cupandcaDdD= @. 


Proof. Suppose M is not connected. Then there exists an open and closed subset U of M such that U 
is neither M nor g@. If we let V = U’, then V is open and V # g@. Therefore y= UUV, Un V= @, and 
U and V are open and nonempty. 

Now suppose that there exist open nonempty subsets U and V of M such that y= yu py and 
Uav = gq. Since U'= V, Uis closed. Thus U is an open and closed subset of M@ which is neither M 
nor g, and hence MM is not connected. Therefore parts (1) and (11) are equivalent. 

The equivalence of parts (1) and (111) is proved in a similar way. m 


We may characterize the connected subsets of the real line using the next theorem. 


Theorem 45.3 A subset X of R is connected if and only if whenever a,b¢x¥ with a < b, we have 
[4, b] < X. 


Proof. Let X be a connected subset of R. Suppose there exist gb¢ x with a < b, but [a,b] ¢ x. for 
some ¢¢X. Then ce[a,b] and U={xeX|x<c} are open nonempty subsets of X such that 
V = {xeX|c<xpand y= yy vp. By Theorem 45.2, X is not connected, and we have a contradiction. 
Thus whenever Un V = g witha < b, we have [a, b] ¢ X. 

Now suppose that whenever abe x with a < b, we have [a,4] < ¥. If X is not connected, by 
Theorem 45.2, there exist closed nonempty subsets C and D of X such that y = cy pandcndD= @. 
Let g¢ c and pe p. We may assume that a < b. Let 


c= lub{xeC|x < 3} 


For every positive integer n, there exists x, ¢ C such that c— 1/n <x, <c. Thus lim, ,,. x, =c, and c 1s 
a limit point of C. Since C is closed, ¢<¢. Now c < b and by our hypothesis, [e, 5] < x. 

We next show that (c, 6) c p. If there exists » ¢(e, 6) such that » ¢ p, then ye c. Now y < band pec; 
SO ye {xe C]|x < 5}. Thus 


ysc=lub{xeC|x < 5} 


Since y € (c, 5), y > ¢ which is impossible, and thus (c, 5) < D. 
Because (ec, b) ¢ D, ¢ 18 a limit point of D, and since D is closed, ¢ep. But now ceCnD= GQ, 
which is a contradiction, and therefore X is connected. my 


Corollary 45.4 A nonempty subset_X of R is connected if and only if X is either a point or an interval. 
In particular, R is connected. 


Proof. Points and intervals are connected by Theorem 45.3. 

Now suppose that _X is a connected subset of R. Let a = glb X and b = lub X. (We let a =— «if X is 
not bounded below, and we let b = « if _X is not bounded above). If a = b, then X= {a}; so suppose a 
<b. Let ce (a, 4). There exist x and y in X such that a < x <c <y <b. By Theorem 45.3, ¢¢ x. Thus 
(a, b) < x. Ifx <a or ifx > b, then x ¢ x. Therefore X is one of (a, b), [a, b), (a, 6], or La, b]. m 


The next theorem is identical to Theorem 44.1 with compact replaced by connected. 


Theorem 45.5 If fis a continuous function from a connected metric space M, into a metric space M,, 
then f(/,) is connected. 


Proof. If M = f(M,) is not connected, by Theorem 45.2 there exist open nonempty subsets U and V 
of M such that y J vy = y andUn V = g. Since fis continuous, f'(U) and f''(V) are open subsets of 
M,. Now mM, =f-(U) Uf~ (Vv), where f'(U) and f''(V) are open nonempty subsets of M/, such that 
f-(U) af (VY) = @. Therefore M, is not connected and we have a contradiction. m 


Corollary 45.6 (Intermediate-Value Theorem) Suppose / is a continuous real-valued function on [a, 
b] such that f(a) < f(b). If y is a real number satisfying f(a) < y < f(b), then f(x) = y for some x in (a, 
b). 


Proof. By Theorem 45.5, f([a, b]) is connected. By Theorem 45.3, [ f(a), f(b)] < f(a, 5). 


We will use Theorem 45.5, to show that R” 1s connected. 


Theorem 45.7 The metric space R” is connected. 


Proof. Suppose R" is not connected. Then there exist open nonempty subsets U and V of R” such 
thatr" = vuvandUnV= gq. Letx =x,,...,x,)¢ Uand y =(y,,...,»,)e VY. Let 


f(t) = (tx, + (I _ 14, {X3 ss (1 Act 1); rene s 1X, fF a= t)y,) 
for 0 <t< 1. We show that fis a continuous function from [0, 1] into R”. [/([0, 1]) is a line joining x 
and y]. 
Lete > 0. Letd = AP (x, — yy. If lt, — to] < 6, then 
k=1 
a( f(t), 42) = re (im, + 1 — ty) - [tox + (1 - 4)y,3}? 
= lt, — tf Y & -— 
k=1 
<6 


and thus fis continuous. 

By Corollary 45.4 and Theorem 45.5, X = f([0, 1]) is connected. Letu, = ¥nU andy, = Xn Vv. 
Then U, and V, are open subsets of X such that y = u, Uv, andU, 0 Vv, = @. Now x = f(l)e U, and 
y =f(0)eV, and thus U, and V, are nonempty. This contradicts Theorem 45.2 and therefore R” is 
connected. gy 


The method of proof of Theorem 45.7 may also be used to prove that /' and FP are connected. 
Exercises 


45.1 Prove that /', 7, c,, /”, and H” are connected metric spaces. 


45.2 (a) Give an example of a subset of R which is connected but not compact. 

(b) Give an example of a subset of R which is compact but not connected. 
(c) Characterize the compact, connected subsets of R. 

45.3 Let fbe a continuous function from a compact, connected metric space M into R. Prove that 
J(M) is a closed interval. 

45.4 Let M be a metric space. Prove that the following are equivalent. 
(a) M is not connected. 
(b) There exist nonempty subsets XY and YofM such that w= xU Y.Xn Y= G= XNF. 

45.5 Let X be a connected subset of metric space M. Prove that x is connected. Is X° necessarily 


connected? 
45.6 Let M, and M, be connected metric spaces. Prove that the product metric space M, x M, is 
connected. 
45.7 (a) Show, by examples, that unions and intersections of connected sets are not necessarily 
connected. 


(b) Prove that if X and Y are connected subsets of R, then xm y is connected. 
(c) Let se, ¢ be a collection of connected subsets of a metric space M such that n¥ + g. Prove 
that Us 1s connected. 
45.8 Prove that an open interval of R is not homeomorphic to a half-open interval of R. 
(Homeomorphic 1s defined in Exercise 44.6.) 
45.9 (a) Call an open cover gy of a metric space M infinitely additive if whenever {U,} is a 
subcollection of g such that nu, « g, then wu, <%. Prove that M is connected if and only if 
every infinitely additive open cover of M contains M. 
(b) Call an open cover gy of a metric space M strongly additive if whenever vu, ve % and 
Unv+@, thenuu vee. Prove that M is compact and connected if and only if every 
strongly additive open cover of M contains M (Johnsonbaugh, 1977). 


46. Complete Metric Spaces 


We define a Cauchy sequence in a metric space analogously to Definition 19.2 which applies to real 
sequences. 


Definition 46.1 Let (/, d) be a metric space. A sequence {x,} in M is a Cauchy sequence if for 
every € > 0, there exists a positive integer N such that if m,n = N, then d(x,,, x,,) <6. 


As in the case of the real line, every convergent sequence in a metric space is a Cauchy sequence. 
Theorem 46.2 If {x,} is a convergent sequence in a metric space, then {x,,} is a Cauchy sequence. 


Proof. Let {x,} be a convergent sequence in a metric space (M, d). Suppose lim, _,.. x, =x. Let ¢ > 
0. There exists a positive integer N such that ifn > N, then d(x,, x) < ¢/2. Ifm,n = N, then 


d(Xms Xp) < (Xp X) + Xm, x) < 5 + ; = s 


The converse of Theorem 46.2 holds for the real line (Theorem 19.3); however, the converse of 
Theorem 46.2 does not hold for an arbitrary metric space. For example, the sequence {I/n}®, 18 a 
Cauchy sequence in (0, 2), but {1/n}, does not converge in (0, 2). If the converse of Theorem 46.2 
holds for a metric space M, M 1s said to be complete. 


Definition 46.3 Let M be a metric space. If every Cauchy sequence in M is convergent, we say that M@ 
is a complete metric space. 


Thus R is a complete metric space, but (0, 2) is not a complete metric space. 

If X is a set with the discrete metric d, X is complete. For let {x,} be a Cauchy sequence in_X. 
There exists a positive integer N such that if m,n = N, then d(x,,, x,) < 4. Therefore, ifn = N, x, = xy, 
and thus {x,,} converges to x,. 


Theorem 46.4 The metric space R” is complete. 


Proof. Let {a be a Cauchy sequence in R". Let ¢ > 0. There exists a positive integer N such that 
ifk,m => N, then 


aera ene 
J Y Gf? — amy = da, a™) <e 
i=1 
If7 is a positive integer with 1 <j <n, we have 
n 
la = a™| < { = (a‘* = al™)? <2 
r=1 


for k,m = N. Thus for 1 <7 <n, the real sequence {a*}2_, is a Cauchy sequence. By Theorem 19.3, 
{a®}2., converges for 1 <j <n. By Theorem 37.2, {a} converges, and therefore R” is complete. 


A variation of the method used to prove that R” is complete may be used to prove that /' (as well as 
I’, cy, and /”) is complete. 


Theorem 46.5 The metric space /' is complete. 


Proof. Let {a} be a Cauchy sequence of points in /'. Let ¢ > 0. There exists a positive integer N 
such that if m,n => N, then 


laf? — af] < [af — af] = a({a™), (2) < (46.1) 
k=1 . 
for any positive integer 7. Thus for any positive integer ; {g =, 1s a Cauchy sequence in R. By 


Theorem 19.3, {g™}# , is convergent. We let a, = lim,.,., a‘. 
From equation (46.1), we have 


© q 2 ir #] N 
y ats Fle — a + Y lgMi<e+ Y lal 
K=1 KEI K=1 kK=1 


ifn => N. Thus for any positive integer p, ifn => N, 


P 
2 alee 


k=1 


where 7 = ¢ + SZ, |a{*|. Taking the limit on n, we have 
P 
Y lal < T 
kel 


for every positive integer p. By Theorem 24.1, {g,} ef. 
Again using equation (46.1), we have for any positive integer p, 


P 
Stal — ap <e 


if m,n => N. Taking the limit on m, we have 

py |a,-a™|<e for n>N 
Taking the limit on p, we have 

d((a,, {0f}) = J. Ia ~ af? <6 


ifn > N, and hence {a™}2,, converges to (g.32, in? in]. 


Definition 46.6 Let (/, d) be a metric space. We say that a metric space (M,, d,) is a completion of 
(M, d) if 

1. (M,, d,) is a complete metric space 

2.Mc M,. 

3. d(x, y) = d,(x, y) for all x and y in M. 


Theorem 46.7 Every metric space (/, d) has a completion. Moreover there exists a completion (M,, 
d,) of (M, d) such that yy = M,, i.e., Mis dense in M, (see Definition 47.1). 


Proof. Let (M, d) be any metric space. Define 
£ = {{x,}", | {x,}2, 18 a Cauchy sequence in (M, d)} 


We say that two Cauchy sequences {x,} and {y,} in (M, d) are equivalent and write {x,} ~ {y,} if 
lim, ,,. UX,» Y,) = 9. 
~ 1s an equivalence relation on ¢, that is, ~ satisfies 
1. {x,} ~ {x,} for all {x} eg. 
2. If {x,} ~ {y,}, then {y,} ~ {x,} for {x,} and {y,} in g. 
3. If {x,} ~ {y,} and {y,} ~ {z,}, then {x,} ~ {z,} for {x,}, {,}, and {z,} ing. 
(1) to (3) are easily verified. 


The relation ~ partitions ¢ into disjoint equivalence classes _X, 1.e., {x,} and {y,} are in X if and 
only if {x,} ~ {y,}- 
We define 
M, = {XX is an equivalence class of the set ¢ under the equivalence relation ~} 


We now make M, into a metric space by defining d, : X x X — [0, 0) by 


d,(X, ¥) = lim d(x,y,) 


where {x,}2.,¢X and {y,}2., € Y. 


cam 1, (M,, d,) 18 a metric space. 

4. d,(X, Y)e[0, 00) and is independent of the elements {x,} and {y,} chosen from_X and Y, since first if 
{x,} eX and {y} « y, we have for eache > 0 there exists a positive integer N such that d(x,, x,,) < 
é/2 and d(y,,, y,,) < €/2 for all n,m = N. Therefore using the triangle inequality we get 


A(Xns Vn) S AXpe Xn) + Ans Yin) + A Ves Ye) 


aud dX Yon) S A(X X4) + dy In) + Aur Yor) 


which implies 
E (Xn Yu) — A Xm» Ven) SA Kp Xp) + EVs Vad 
A(Xms Ym) ia A(X, Yn) Ss A(X Xa) r L( Vins Yn) 


and this implies 


=€E 


é € 
Ens Vn) — Fs Yond] S Aa» Xm) + Am Ya) <5 +5 


This implies that the real sequence {d(x,, y,)}@., 18 a Cauchy sequence; therefore, since R is 
complete, lim, ,,, d(x,, y,) exists, and since each d(x, y,) €[0, 0), lim,..,, d(x,, ¥,) €[0, 00). Now if 
{x'}eX and {py} ey are any other elements of X and Y, we have lim, ,,, d(x,, x’) = 0 and lim, ,,. 


d(y,, V',) = 9; therefore, 

|4(Xns Vn) — AXns Vad S @%q Xm) + AYas Vad) 
Thus lim (xq, ¥,) = lim d(xt, y!) 
so d,(X, Y) is well defined. 


5. dX, Y) =d,(Y, X) for all X and Yin M, is obviously true. 
6. dX, Y) <d,(X, 2) + d,(Z, Y) for all_X, Y, and Zin M, since 


d,(X, Y) = lim d(x,, y,) <= lim [d(x,, Z,) + d(Z,, ¥,)] 


= lim d(x,, 2,) + lim d(z,, ¥,) = 4,(¥, Z) + d,(Z, ¥) 
using the triangle inequality for (M, d) and 4. 
By (4)-(6) we have that (M/,, d,) is a metric space. 


aam 2. (M,, d,) is a complete metric space. 
7. Let {x,}2., be a Cauchy sequence in (M,, d,). We must find x e m, such that lim, _.,. X,, =~. 
First we prove a useful result. If S is a subset of M, we define p(S) = lub {d(x, y) |x and y are 
elements of S}. p 1s called the diameter of S in (M, d). 
Take x eM, We want to show that for every e > 0, there exists a Cauchy sequence {x} « x such 
that the diameter of {x,} in (WV, d) is less than ¢, 1.e., p({x,}) <e. 
Choose any {y,}, eX. Since {y,} 1s a Cauchy sequence, there exists a positive integer N such 
that for m,n = N, d(y,, y,,) < €. Now the subsequence {y,,, ;}%2, has diameter less than ¢ in (M, d). 
Define {x,}2., by x, =yy,,; fori = 1, 2,.... Now {x,} ex since lim,_,,, d(x, y,) = lim,_,,, (vi. V,) 
= 0. For each X, in our given sequence choose {x} ¢ x, such that p({x}2,) < ijn. Recall 
d,(X,, X,,) =lim,..,, do, x). Consider the sequence jim,.,, d(x", xf). Let ¢ > 0. Since {y,}, is a 
Cauchy sequence in M,, there exists a positive integer N such that if m,n > N, d,(X,, X,,) < é/3. 
Choose a positive integer L, such that L > N and 1/L < ¢/3. Now for each m,n > L we have that 
d(X,, X,,) < €/3, 1.€., lim,.,, dx”, x!) < 2/3. Thus there exists a positive integer k, such that 
d(x{, xf) < 2/3. Now 


dex, xy) < A), XE) + dx, xf?) + dxf”, x1”) 
a ee a ee ae 
we a ae a a gee 
which implies {x} , is a Cauchy sequence in (M, d). Therefore by our definition of M,, there 
exists Xe M, such that sx} 2 ex. 
We now prove that lim, _,,, d,(X,, X) = 0. A picture is handy at this point. We have 


CY Ee eek 
2 
Gt, x, xf - os ) e Xx, 


ee) 


($?, 20", x97, .. JEN, 


(oA ee J EX 
and we are showing that X, — Xin (M,, d,). 


ifn, i > L, then there exists J such that g(), x) < 2/3. Now ifn, i 2 L, then 


Now tim, ,,, @,(X, X) = lim,.... lim;., d(x, x). Using L from the previous argument, we have that 


Aix, xP) < d(x, x9) + d(x, x8) + dxf, x?) 

| seo 

a= ss = 
me & of 


1 8 
| ie 
which implies lim,_,,, d,(X,, X) = 0. Therefore, (M,, d,) 1s complete. 
8. We now have two metric spaces (M, d) and (M,, d,). We now imbed / into M, in sucha way as to 
preserve its metric. 

For each x ¢ yg, the sequence {x, x, .. .} 1s a Cauchy sequence in MV; so there exists an Ye M, 
such that fx, x,...} eX. We define [/(x) =X. IT: M — M, and for each pair x,y eu we have I/(x) = 
X and I/(y) = Y, but also d,/[(x), [(y)) = lim,_,., d&, v) = d(x, y) by definition of d, and the fact 
that {x,x,...}¢X and {y, y,...}¢¥. Therefore M and [/(M) are identical as metric spaces, since I] 
is a one-to-one, onto, metric preserving mapping from M onto //(M). (We say M and /I(M) are 
isomorphic metric spaces, and IT is a metric space isomorphism.) But M(M) < M, and M, is 
complete; so M, is a completion of WV, 1.e., M, is a completion of M, using the identifying function 
TT. 

Our last step is to show that (a4) = mu, Let xe M,. We must show that there exists a sequence 
{x,}2., in [1(M) such that X, — X in M,. Take any {x,3~,. Define X, = //(x,). Recall that 
(x,, x;,X;, ...) e(X). Now xX; —_X, since lim, ,,, d,(X,, X) = lim,,,, lim,_,,, d(x, x,) = 0 since {x}2 , is 
a Cauchy sequence in M. Therefore Ti(a#) = m,. We call (V,, d,) the completion of the metric 
space (M, d). Recalling that it is not true directly that 4 < M,, but under the metric space 
isomorphism //, it is true that 7(M) < M, and 74) = M, 


Example 46.8 Let us apply our results from Theorem 46.7 to the metric space (M, d) = (Q, d), where 
Q is the set of rational numbers and d(x, y) = p — y for all x,»¢@ is the usual Euclidean distance. 
Now M, will be the collection of all equivalence classes of Cauchy sequences of rational numbers. If 
X and Ye M,, then by taking any {y,} ¢ X and {g,} e y, we have d,(X, Y) = lim,_,., 1, — 74 

The mapping /7: Q — M, is, for example, 7(3) = x, where X is the set of all Cauchy sequences of 
rational numbers which converge to 1. Note that (4, 4,4, . . .) 1s one such sequence. 


(M,, d,) can be shown to satisfy Definition 3.2. That is, M@, = R. Thus the proof of Theorem 46.7 
can be used to construct the real numbers from the rational numbers. 


Exercises 


46.1 Prove that every finite subset of a metric space is complete. 
46.2 Give an example of a complete metric space which is not compact. 
46.3. Give an example of a connected metric space which is not complete. 
46.4 Give an example of a complete metric space which is not connected. 
46.5 Let M be a metric space. 
(a) Prove that if Cis a complete subset of M, then C is closed. 
(b) Prove that if / is complete, then every closed subset of M is complete. 
46.6 Let {a,} be a Cauchy sequence ina metric space M. Prove that {a, | »¢P} 1s bounded. 
46.7 Prove that a compact metric space is complete. 


46.8 Prove that /’, c,, and /” are complete metric spaces. 

46.9 Let M, and M, be complete metric spaces. Prove that the product metric space M, x M, is 
complete. 

46.10 Let {X,} be a sequence of closed and bounded subsets of a complete metric space such that 
X, > X,41 for every positive integer n and lim, (diam_X,) = 0. (See Exercise 43.4.) Prove 
that \z., x, contains exactly one point. Exercise 46.10 is a generalization of the nested interval 
theorem for R (see Exercise 16.8). 

46.11 (Banach's theorem) Let fbe a contraction mapping on a complete metric space M. (See 
Exercise 44.7 for the definition of a contraction mapping. ) 

(a) Let x,em. Letx,,, =/(x,) forn=1,2,.... Prove that {x,} 1s a Cauchy sequence in M. 

(b) Prove that ifx = lim,_,., x, where {x,,} is the sequence defined in part (a), then f(x) =x. 

(c) Prove that there is only one point x ¢ yg such that f(x) = x. Banach's theorem provides 
another example of a fixed point theorem. (See also Exercise 42.12.) 

46.12 Let M, and M, be metric spaces such that M, is complete. Let fbe a uniformly continuous 
function froma subset_X of VM, into M,. Suppose that x = M,. Prove that f has a unique 
uniformly continuous extension from M, into M, (that is, prove that there exists a unique 
uniformly continuous function g from M, into M, such that g,X =f) 

46.13 We say that a metric space M 1s totally bounded if for every ¢ > 0, there exist x,,...,%,¢M 
such that 7 = B{x,;) u---U B.Cx,)- 

(a) Prove that if / is a totally bounded metric space, then / is bounded. Give an example to 
show that the converse is false. 

(b) A metric space in which every sequence has a Cauchy subsequence is said to be 
conditionally compact. Prove that a metric space // is conditionally compact if and only 
if M is totally bounded. 


(c) Let M be a metric space. Prove that M is compact if and only if / is complete and totally 
bounded. 


46.14 Find the completion of each of the following spaces with the given metric and justify your 
answer. 


(a) M= (x,y) €R?| x, ye Q} With the usual metric for R’. 

(b) M as in (a) with the discrete metric for R’. 

(c) M= {(x, sin (I/x) ¢R?| 0 < x < 1} With the usual metric for R’. 

(d) = {{a,}¢2| there exists y¢p such that a, = 0 for all n => N} with the usual metric for /'. 


47. Baire Category Theorem 
We begin with a definition. 


Definition 47.1 Let M be a metric space and let X be a subset of M. We say that X is dense in M if x 
= M. 

Thus X is dense in (VM, d) if whenever xe ag and ¢ > 0, there exists ye x such that d(x, y) < «. 
Alternatively, X is dense in M if whenever x ¢ yg and ¢ > 0, we have B(x) n ¥ ¥ @. For example, the 


set of rational numbers (or the set of irrational numbers) is dense in R. 
We come now to our main theorem from which we will deduce the Baire category theorem 
(Theorem 47.5). The proof is illustrated in Figure 47.1. 


Theorem 47.2 If {U,} 1s a sequence of dense open sets in a complete metric space M, then), U, 1s 
dense in M. 


Proof. Let xe and let ¢ > 0. We must show that there exists ye (\#., U, Such that d(x, y) < é. Since 


U, is dense in M, there exists y, e U, 0 B(x). Since U, - Bx) 18 open, there exists an open ball B, (y,) 
such that B,,(y,) ¢ U, 9 B(x). Let 0, = min {¢,/2, 1}. Since U, is dense 


Figure 47.1 


in M, there exists y, € U, 9 B;,(y,). Since U, m B;(y,) 1S open, there exists an open ball 8,,(y,) such that 
B..(2) < Uz, 0 B;(y,). Let 6, = min {é,/2, 1/2}. We continue this process inductively. At the next step 
we choose y, € U; 9 B;,(y,) and an open ball B,,(y3) < Us 9 B;,(y2) and we let 6, = min {é,/2, 1/3}. 

We now have a sequence {y,} and open balls {8, (y,)} and {B, (»,)} Satisfying 


Beare) S Tay 9 Bs (Vn) 


where 3 | 
6, = min <=>, - 
2°n 


forn =1,2,.... NOW By, (n41) © Be .,(ne1) © Bs,(,)» thus 
Yo Bs.) ifm>n (47.1) 


Since 6, < 1/n, we have d(y,,,, y,) < 1/n ifm > n, and therefore {y,} is a Cauchy sequence. Since M is 
a complete metric space, lim, ,.. y, = for some y in M. It follows from (47.1) that ye B, (y,)~ for n = 
1,2,....Since dé, <¢/2, we have 


ve Bs (Vn) c Bn) c Ben) Cc U, 


forn=1,2,.... Therefore ye ()\@, U,. Finally, ye B,,(y,) < B(x), and thus d(x, y) <¢. m 


Definition 47.3 Let M be a metric space and let_X be a subset of M. We say that _X is nowhere dense 
(in M) ifX” =M. 

For example, a point of R is nowhere dense in R. However, a point of P is not nowhere dense in P. 
These examples show that the concept of a set XY being nowhere dense is defined only relative to a 
metric space of which_X is a subset. This situation is different from such concepts as compactness or 
connectedness. A set_X is compact or connected in and of itself. It is immaterial in which metric space 
it resides. 

Before giving the next definition we note that a closed set X is nowhere dense in M if its 
complement is dense in M. 


Definition 47.4 Let M be a metric space and let_X be a subset of M. We say that X 1s of first category 
(in M) if X is a countable union of nowhere dense sets. We say that _X is of second category (in M) if 
X is not of first category (in M). 

Just as the definition of X being nowhere dense is relative to the metric space M of which X is a 
subset, so too are the concepts of first and second category relative to the containing metric space M. 

It is easy to see that a countable union of sets of first category (in M) is of first category (in /). We 
pointed out before that a point 1s nowhere dense in R, and thus any countable subset of R is of first 
category in R. In particular, the set of rational numbers is of first category in R. If the set of irrational 
numbers were of first category in R, thenrk = Qu Q would be of first category. This is not, however, 
the case as the Baire category theorem shows. 


Theorem 47.5 (Baire Category Theorem) If // is a nonempty complete metric space, then M is of 
second category (in /). 


Proof. Suppose that M is of first category. Then yw = (J%, A, where each A, is nowhere dense in 
M. Now mM = ()@., 4; and thus g =(\2., (47’). Now each set 47’ is an open dense subset of M; so by 
Theorem 47.2, @ = (\%.,(A;’) 1s dense in M. This contradiction establishes the theorem. ™ 


=1 


The Baire category theorem has many applications in analysis. The usual application is to show 
that a point x of a complete metric space exists with a particular property P. A typical argument runs 
as follows. Let ¥ = {x eM | x does not have property P}. By some argument, we show that X is of first 
category. Since M is of second category, there exists + < ag ~ x’. Thus x has property P. 

We give one interesting application of the Baire category theorem. 


Definition 47.6 Let M/ be a metric space and let x ¢ yy. We say that x is an isolated point of M if for 
SOME ¢ > 0, B(x) 0 M = {x}- 


Theorem 47.7 If Mis a complete metric space with no isolated points, then M is uncountable. 


Proof. Suppose M is countable. Then = ()z., {a,}, and each set is nowhere dense, since M has no 


n=l 


isolated points. Thus M 1s of first category, and this contradicts Theorem 47.5. gy 


Corollary 47.8 If / is a compact metric space with no isolated points, then Mis uncountable. 


Proof. A compact metric space is complete. Now apply Theorem 47.7. ™ 


Exercises 


47.1 Use the Baire category theorem to prove that irrational numbers exist. 

47.2 Do Exercise 9.10 using the Baire category theorem. 

47.3 Prove that {0} is of first category in R, but that {0} is of second category in itself. 

47.4 Assuming Theorem 47.5 (Baire category theorem), deduce Theorem 47.2. 

47.5 IfM is a metric space and X is a subset of M, we say that X is a G, set if X is a countable 
intersection of open sets. Prove that the set of rational numbers is not a G, set in R. 

47.6 Iffisareal-valued function which is bounded on an open interval J containing a, we let 


wT) = lub {f(x) | xe 7} — glb (f(x) | x eZ} 


and w(a) = glb {@{/) {J is an open interval containing a} 
(a) Prove that fis continuous at a if and only if @(a) = 0. 
(b) Prove that if > 0, then {x | @{x) <é} 1s open. 
(c)° Prove that there is no function fon R such that fis continuous at every rational point and 
discontinuous at every irrational point. 
In Section 33 (Exercise 33.4), we defined a function which is continuous at every irrational 
point and discontinuous at every rational point. 
47.7 (a) Let M, be acompact metric space and let (/,, d) be a complete metric space. Let ¢(a4,, M2) 
denote the set of all continuous functions from M, into M,. Prove that 


d*(f, g) = lub {a( f(x), g(x) | x © My} 


defines a metric on ¢(M,, M,) and that ¢cz,, M,) 1S a complete metric space. 

(b)° Let M, and (M,, d) be metric spaces and let fbe a continuous function from M, into M,. 
We say that fis an e-mapping if whenever x, x’ em, and f(x) = f(x’), we have d(x, x’) <«. 
(“fis within ¢ of being one to one.”) Prove the following result due to Hurewicz (see 
Hurewicz and Wallman, 1941). Let M, be a compact metric space and let M, be a 
complete metric space. If for every ¢ > 0, the set G, of e-mappings of M, into VM, is dense 
in ¢(M,, M,), then V/, is homeomorphic to a subset of M,,. 

47.8° Prove that the closed interval [a, b] cannot be written as a disjoint union of closed intervals 
of length less than b — a. 

47.9" Let f(x, y) be a function from R’ into R such that for each x eR, £0) =f(x,y) 18 a polynomial of 
finite degree in y (the degree dependent only on x). Also for each yer, £0) = f(x, y IS a 
polynomial of finite degree in x (the degree dependent only on y). Prove that f(x, y) is a finite 
polynomial in x and y, that is, 


£9) = "a PH a,,x'y) for all x and y 


Vill 


Differential Calculus of the Real Line 


In this chapter we review many of the topics which are covered in introductory calculus texts. 
48. Basic Definitions and Theorems 


Definition 48.1 Let fbe a real-valued function defined at all points of an open interval (a, 5) inR. 
For each x in (a, b), we define 


pox yx 


if this limit exists. If f(x) 1s defined, we say fis differentiable at x, and we call the number /'(x) the 
derivative of f at x. If f(x) is not defined, we say f1s not differentiable at x. If f is differentiable at 
each point of (a, b), we say that fis differentiable on (a, b). 


In dealing with functions which are defined only on closed intervals [a, b] it is sometimes useful to 
use the concept of right and left derivatives at the endpoints b and a; so we have the following 
definition. 


Definition 48.2 Let fbe a real-valued function defined at all points of a closed interval [a, 5] in R. 
For each x in[a, b], we define 


sao) = 0) fe) | Fite tim AO f@) 


ban ae Ae 


IQ) = 


if these limits exist. /'(x) and f(x) are called the right and left derivatives of f at x (when they are 
defined). 


By Theorem 32.2 we see that f(x) exists if and only if f(x) and f(x) exist and f(x) =/(x) [=/ 
(x)]. 


We say a real-valued function fis differentiable on the closed interval [a, b] with a < b if f is 
differentiable on (a, b) and /’(a) and f(b) both exist. 


Examples 48.3 (a) Let f(x) = |x| on [—1, 1]. Then /’,(0) = 1 and (0) = —1 both exist, but /(0) does 
not exist, since f’. (0) # (0). Note that 


I'() = -1 forall -l<x<0 
f'@®=1 for allO < x < | 
f(-)=-1 and ff()=1 


(Verify.) (See Figure 48.1.) 
(b) Let 


(See Figure 48.2.) 


Figure 48.2 


Verify that /(—1) = 0 and f’,(—1) does not exist and that therefore f(—1) does not exist. Verify that f(x) 
= 0 for all -2 <x <-—l and f(x) = —x/ /T — x for all —1 <x <1. Also show that /’(1) does not exist. 


Theorem 48.4 If fis differentiable at a point c, then fis continuous at c. 


Proof. We are given that 


lim? FO ie 


are = f(c) 


exists. 


a tim f(y) ~ fle) = tim P= LO fy — oy 


= "119 (y - 0c) =f(c)-0 = 0 
yoo > alma yore 


So lim, ,. ftv) =/(c), which says f'is continuous at c. ™ 


The converse of Theorem 48.4 is not true. For example, Example 48.3(a) is continuous at 0, but not 
differentiable at 0. 


Theorem 48.5 Suppose f and g are defined on an open interval (a, b) and are differentiable at a 
point c in (a, b). Then f+ g, f-g, and f/g [g(c) # 0] are differentiable at c and 


(a) (f+ g)'(c) =f) + 8) 
(b) (Fg) =fO a) + fle)'g') 


(c) (2) @-0- soso 


[g{c)]* [g(e) # 0] 


Proof. (a) 1s left as an exercise. 


aoe —F-NE} _ m2 9) — f(e)-g(c) 
—c sat yre 
wi Him a( fO) 10) =e) ue = f a 
=f): g'(c) + “ ‘(¢) 
The last equality holds by Theorem 48.4 and the algebraic properties of limits. 
(c) We have 


(f-g9)'(e) = ve 
(b) 
+ g(c) 


(Z ) (c) = tim LOO = GVO _ 5, SG) = KOO 


ye yoo ye 
. fw) = fo a) = af 
lh Foros (ao a eee 622) | 


_ 9): Fo) — f©)-9'©) 


[SOF - 


Examples. (a) If f(x) =c for all , ¢R (where c is a fixed constant), then f(x) = 0 for all , cr, since 


OE gent Se 


= lim —— = 0 


I@ = efor op a 


(b) If f(x) =x for all yc. Then /(x) = 1 for all y eR, since 


(im tO ELD) P= 
a ar 


(c) If f(x) = x? = x-x for all y eR. Then by Theorem 48.5(b) f(x) = 1-x + x-1 = 2x for all yer. 
Using induction on n and Theorem 48.5(b), we may prove the following. 
(d) If f(x) =x" for n a positive integer and for all y <R, then 


f'(x) =nx""* forall xeR 


Theorem 48.6 (The Chain Rule) Suppose fis a function on (a, b) and f(c) exists at some c ¢€ (a, 
b). Suppose g is defined on an interval /, which contains the range of f, and suppose g is 
differentiable at the point f(c) in/. If we define K(x) = (g ° f)(x) = g(f(x)) for all x in (a, b), then K is 
differentiable at c and 


Ke) = 9( fe) SO) 


Proof. Ki) = im ED=KO _ jp PFO = FO) 


yore ere yoo y-e 
cas 1. If there exists an € > 0 such that for all y with 0 < |y — c|< €, we have f(y) # f(c), then since f 
is differentiable at c, fis continuous at c (Theorem 48.4); so 


Pog (y) = f(c) 
Therefore 


wee gf) _ 4, 69 FO). - sO) 


K'{(c) = ae = a ea 
O<|y-e] <c 
~ tim WD = afl) f) = flo 
~ F=f y—e ~FVOSO 


O<|y—cl<e 
since g"(f(c)) and f'(c) both exist. 


cas 2. If there exists no € > 0 such that for all y with 0 < |y — c| < €, we have f(y) # f(c), then this 
implies there exists a sequence {g }#_, such that for each n, we have 0 < |a, — c| < 1/n and f(a,) =f(c). 
In this case we have 


r= tim =F fo fo) onlin S(a,) — f(c) — lim 0 ail 
bed n+ a, — norco &y = 
Let {q.}#., be any sequence such that lim, ,.. a, =c, and a, # c for eachn. Let M= ty |y#cand f(y) = 
f(c)}. Then 


tim ZGw) = 9FO) _ GF) — 9) 


n+ a, — ec nora a — ec 
a,eM o,eM 


=0 


fim SL) - HAO) _ GM.) - 9 KO) f(@,) - fO) 


= iim 
and . me ne 4Q—7o) a, —c 
OneM ant 


= 97 FCO) SO = g'FO)-0 = 0 


Therefore, we conclude that 


pe g(fla,)) — gfe) 


no a,— ec 


=0 


for each sequence {g}* , with lim,_,,. a, =c and a, # c for eachn. This implies, by Theorem 31.2, that 


ig gU{(y)) — gc) 


yor ym oC 


=0 


Therefore, K'(c) exists and equals 0. But 0 = K'(c) = g'(f(c)):0 =g'(f(c)): f(c). m 


Examples. (a) Let K(x) = (x7 + 3)!” on (-1, 1). Then K(x) = g(f(x)), where f(x) =x? + 3 on (1, 1) 
and g(v) = y!” on the interval J = (3, 4), which is the range of fg is differentiable at each point of / 
and 


g'(y) = oF 
fis differentiable on (—1, 1) and f(x) = 2x. Theorem 48.6 gives us that 
K(x) = 9’) -S'@) 


for all x in (—1, 1). So 
K'Q) = = ey 
= GSO - IEEE" THF 


for all x in (—1, 1). 
(b) Let K(x) = (x? + 2)'° on R. Using Theorem 48.6, we see that K’(x) = 30(x? + 2)’ x’ for all x inR. 


Exercises 
48.1 Suppose fis a real-valued function on (a, 5) and f'(c) and f’,(c) exist for some c ¢ (a, b). Can 
jf be discontinuous at c? Prove your answer. 
48.2 Suppose f(x) = 0 for all x € (a, 5). Prove that fis constant on (a, 5). 
48.3 Suppose /’ is continuous on [a, 5] and € > 0. Prove that there exists 6 > 0 such that 


r= <= 6 


LQ =L _ pg 


whenever 0 < |t — x|< 0, withx and ¢ in [a, 5]. 
48.4 (a) Prove that fis differentiable at a if and only if there exists a function E(h) defined on an 


open interval (—0d, 0) and a constant c such that 
f(a + h) = f(a) + ch + Eh) 


where lim,_,, (E(h)/h) = 0. 
(b) Prove that in case fis differentiable at a, the constant c of part (a) is equal to f(a). 
(c) Use part (a) above to give another proof of the chain rule. 
48.5 Suppose fis continuous on [a, b] and /’ (x) = 0 for all x € [a, b). Prove that fis constant on [a, 
bj. 


49. Mean-Value Theorems and L‘Hospital’s Rule 


Definition 49.1. Let f be a real-valued function defined on R. We say f has a local maximum at a 
point c ¢ Rif there exists a 6 > 0 such that 


f(x) <= fe) ~—s for ali x e R such that |e — x| < 6 


In other words in some open interval about c, f(c) is the largest value which f takes on in this interval. 
We say f has a local minimum at a point d ¢ R if there exists a 6 > 0 such that 


f(x) => f(a) ~— for all xe R such that |d — x] < 6 


Examples 49.2 (See Figure 49.1.) (a) Let f(x) =—x* + 1 on R. Then c = 0 is the only local maximum 
of fon R. fhas no local minima on R. 

(b) Let g(x) = x(x? — 3) on R. Then c = —1 is the only local maximum and d = | is the only local 
minimum for g on R. 

(c) Let A(x) = x3/5 — x3 4 4x on R. Then c, = —2 and c, = | are the only local maxima, and d, = —1 
and d, = 2 are the only local minima for / on R. 

(d) Let k(x) = |x| for x in R. Then d= 0 is the only local minimum for é in R. 
The following theorem is the basis of many of the applications of differentiation. 


Theorem 49.3 Let f be defined on [a, 5]. If f has a local maximum at a point c ¢ (a, b) and f(c) 
exists, then /'(c) = 0. 
Proof. Suppose f(c) is a local maximum and /'(c) exists. Then 


We) = file) = lim LALO 
a ale tee 


and since f(c) > f(y) for all y sufficiently close to c, we must have f(y) — /f(c) < 0 and therefore 


fy) — f) > 0 
yre 


for all y sufficiently close to c and with y — c <0. Therefore, taking the limit, 


f') = fi = 0 (49.1) 


Now 10) = flo = tim L2=LO 


and again f(y) — f(c) < 0 for all i sufficiently close to c; so [f(v) — f(c)|/y - c) < 0 for all y 
sufficiently close to c and with y — c > 0. This implies 


fO =f <0 (49.2) 
Inequalities (49.1) and (49.2) give that 


0s file) =f'(e) = f{(©) < 0; sof'(c) = 0 


Figure 49.1 


Corollary 49.4 Let f be defined on [a, 5]. If fhas a local minimum at a point d in (a, b) and if f'(d) 
exists, then /'(d) = 0. 


Proof. —fhas a local maximum at d and (-f)'(d) = -(/'(d)) exists; so Theorem 49.3 says (—f)'(d) = 


0. Therefore —(/'(d)) = 0; so f'(d) = 0. m 


If fis differentiable for all points in (a, 5), then by investigating the behavior of f only at the points 
where f(x) = 0, we are able to find all the local maxima and minima of fon (a, b). However, f(x) = 0 
does not always imply that f(x) is either a local maximum or local minimum. For example f(x) =x° on 
(—1, 1) has no local maximum or local minimum, however, /'(0) = 0. Also note that in Examples 
49.2(a), (b), and (c) we could find all the local maxima and minima by finding where /f’, g’, and h' 
were 0. However, in (d) the local minimum occurs at a point where k’ does not exist. 


Theorem 49.5 If fand g are continuous real functions on [a, 6] which are differentiable in (a, 5), 
then there is a point c € (a, b) at which 


LAO) — f@)-9'(c) = [g) — o(@)l-f’o) (49.3) 
Proof. Define 
h(x) = Lf) — f@le() — fo) — g@]fx) for all xe fa, 8). 


Then / is continuous on [a, 5] and differentiable in (a, b) and 


Ha) = fB)g(a) — flag(d) = i(b) (49.4) 
All we need 1s that there exists c ¢ (a, b) such that h'(c) = 0, for then 
0 = A'(c) = Lf) — flag’) — (9) -— g@I') 


If h is a constant function, then h'(c) = 0 for all c in (a, b), which completes the proof. 

Suppose h(t) > h(a) for some ¢ in (a, b). By Theorem 34.4, h attains a maximum at some c in [a, b]. 
But by (49.4), since h(c) => h(t) > h(a), we must have c € (a, b); so by Theorem 49.3, h'(c) = 0. 

If h(t) < h(a) for some ¢ in (a, 6) a similar argument gives us ac € (a, b) withh'(c) =0. @ 


The above theorem is often called the generalized mean-value theorem. 


Theorem 49.6 (The Mean-Value Theorem) _ If fis real-valued and continuous on [a, b] and f is 
differentiable in (a, 5), then there exists a point c ¢ (a, b) such that 


S) — f@ = @ - af’) 
Proof. Take g(x) =x in Theorem 49.5. m 


Corollary 49.7 (Rolle's Theorem) — Let f be a real-valued continuous function on [a, b] which is 
differentiable in (a, b) and suppose f(a) = f(b). Then there exists c ¢ (a, b) such that f'(c) = 0. (See 
Figure 49.2.) 


Proof. By Theorem 49.6 there exists a point c € (a, b) such that 0 = f(b) — f(a) = (6 — a)f'(c). This 
implies f'(c) = 0. m 


Definition 49.8 — Let f be a real-valued function defined on an interval 7. We say f is increasing 
(decreasing) on I if for each x and y in J with x < y, we have f(x) < f(y) [{x) = fiy)]. We say fis 
strictly increasing (strictly decreasing) on I if f(x) < ftv) [fx) = ftv) for all x and y in J withx <y. 


Theorem 49.9 Suppose fis real-valued and differentiable in (a, b). 


(a) If f(x) = 0 for all x € (a, b), then fis increasing on (a, b). 
(b) If f(x) = 0 for all x € (a, 5), then fis constant on (a, 5). 
(c) If f(x) < 0 for all x € (a, 5), then fis decreasing on (a, b). 


Proof. All conclusions can be read from the equation f(x,) — f(x,) = (x, — x,) - f(c), which is 
valid for each pair of points x, <x, in (a, b) and for some c with x, < c < x, (Theorem 49.6). m 


Theorem 49.10 If f(x) > 0 for all x in (a, b), then fis strictly increasing in (a, 5). 
Let g be the inverse of f. Then g is differentiable at each point in the range 


Figure 49.2 
of f and 
eh fy — 2s 
g’({(x)) = 7) for all x € (a, d) 


Proof. First, for each x, <x, in (a, 5), there exists, by Theorem 49.6, c ¢ (a, b) such that 


f(%2) — fe) = G2 — xf") 


So PGs teak 8.7) ea 
ec 


thus f(x,) —f{x,) > 0. Therefore, fis strictly increasing on (a, 5). Furthermore, f has an inverse, call it 
g, with domain g = (f(a), f(b)) (verify). Recall g(v) =x if and only if f(x) =y. fis differentiable in (a, 
b); so fis continuous on (a, b) by Theorem 48.4. 

Let y € (f(a), f(b)). Then y = f(x) for a unique x in (a, b). Therefore, 


wee ia — tim $2 - Gf) _ GQ) - =x 
BE on PWIA. nie EF 


For all z sufficiently close to f(x), we have z & (f(a), f(b)); so since f is one-to-one, there exists a 
unique x, in (a, b) such that f(x,) =z. Since fis continuous and strictly increasing, 


li = 
yes aoa (49.5) 
We now have 
7 - g(z) - . gf(x))-—x 
g'(y) = gf) ae = aa me Wx) — Fa) Fe 


x,— <x : 1 


; 1 
= if Sa SC oe——eeeeeeee|_ ee 
casey 10) — FC) ~ 21m FO) = FO —) ~ FR) 
The last equality follows by (49.5) and the fact that f(x) exists. gy 


If we had known that g was differentiable at f(x), since 


g(f(x)) =x forall x in (@, d) (49.6) 


we could have applied Theorem 48.6 to the left side of (49.6) and usual differentiation rule on the 
right to get 


9g'(F() -f') = 1 (49.7) 


Example. Let f(x) TUG) S (0,@) ot Then f’(x) = 2x > 0 for all x in (0, 2). g() = yp is the inverse of fon 
(f(0), f(2)) = (0, 4). By Theorem 49.10, 


1 1 
10) = 9 UO) = 765-3 - TF 


since /} = g(y) = x- For example, if y = 3, then 7.3) = 3; SO 9'(3) = g'(fL/3) = 1/23: 
The following theorem, which arises from Theorem 49.5, gives a simple procedure for the 
evaluation of limiting values of quotient functions. 


Theorem 49.11 (L‘ Hospital’s Rule) Let fand g be differentiable on the interval [a, 5), with g’(x) # 0 
on [a, b). 
(1) If lim f(x) =0 and lim a(x) = Dor 
(ii) If lim f(%) = « and lim g(x) = 0 
xh 
andif jm2@Meurz 
x. 


then lim i a 


The end “point” 5 may be finite or “co,” and L may be finite or “oo.” 


Proof. | We will prove the theorem under hypothesis (i), and we shall assume that 5 is finite; 
therefore for convenience we take b = 1. 

Since lim,.,,-/() = lim,.,- g(x) = 0, we define f(1) = g(1) = O and therefore have f and g 
continuous on [a, 1]. Applying Theorem 49.5, we have that for each a < x < 1, there is a point x” with 
x <x° <1 such that 


FC) _ Ff) -f@) _ f) 


g’(x*) gl) — g(x) gx) 


Since f'(x*) 
lim = = J, 
xtai- g'(x*) 
we may choose 0, > 0 so that 
"ye 
“ - 1|- OS - 1 < : whenever 1—6,<x< 1 


This proves that fim, ,,- [f()/g(x)] = L as desired. Under hypothesis (11), we again assume b = 1. 
Given € > 0, we choose 0 so that whenever 1 — 6 < ¥< 1, 


<e and f(x) #0 


Set x) = 1 — 6 and take any point x with x, <x < 1. By Theorem 49.5 there exists =, with x) < ¥< 1, 
such that 


f@) = fo) _ f’'@ 
a(x) — 9) 9) 


Therefore f(x) — f%o) _ 


g(x) — g{x») 


Define h(x) = (1 —f(x,.)/A(x))/C = g(X,)/g(x)) for all x where this expression is well-defined. Then 


f@) 
g(x) 


-hA(x) — Li <e 


is valid for all x with x) < x < 1. Since lim,_,,- f(x) = lim,..,- g(x) = oo, it follows that lim,_,,- A(x) = 1. 
Choose x, € (x9, 1) such that |h(x) — 1| < € and A(x) > 4 whenever xe (x,, 1). For such values of x, we 
have 


(43-2) hi =| (x I ix) - L-h(x) 


g(x) 
a ) 
=|) ) 


h(x) — 1 + |L-[1 — A(x)]| < ¢ + |Z]-e 


and f(x) _ 7 . 
g(x) 


(1 + [Ze 
A(x) 


< 2(1 + |Z£ie 


This proves that lim,.,-Lf@)/g)] = Z- Proofs of the other modifications of the theorem are 
straightforward. For example, in the case b = 0, we consider 


F(x) =f (3) and G(x) = a(=) 


x x 
If f'and g obey (1) or (11) for x — ©, then F and G obey them for x — 0°. Since 


Fo _ fj 
Gm) g Ale) 


we may apply the previously proved form and conclude that if 


then . 
Examples. (If you dit gam ar with the functions sin (x) and cos (x), see Chapter XI.) 
(a) Evaluate 


. eos 
lim —z 
xo- x 
By L‘Hospital’s rule, 
. ox 2x cos x* cos x 
lim rr ; 3 = 5} = 
z0- zo- 4X x+o- 2 
(b) Evaluate 
. 1 — cos x? 
lim z 
a OF x 


It is clear that L‘Hospital’s rule may be modified to hold for right-hand limits; so applying 
L‘Hospital’s rule twice, we have 


1 — cos x? 2x sin x? sin x 
om. ‘i 7 x70" 4x° ~ on ae 
_ 2x cos x” cosx? 1 
7 an 4x eer 3 


Exercises 


49.1 


49.2 
49.3 


49.4 


49.5 


49.6 


49.7 


49.8 


Let fbe continuous on (a, 5) and let x ¢ (a, b). Suppose f(y) exists for all y in (a, b)\{x} and 
lim, ,../((v) exists. Prove that f(x) exists. 

Suppose /’(x) exists and is bounded on all of R. Prove that fis uniformly continuous on R. 
If f, g, h are continuous functions on [a, b] which are differentiable on (a, b), then prove that 
there exists c € (a, b) such that 


flatg(b)h'(c) — A(d)g’(c)] + Ala f()g’lo) — gd) Fo) 
= gal f(yr'(c) — WA) F'(C)] 


Suppose 
(a) fis continuous on [0, ©) 
(b) f(x) exists on (0, 0) 
(c) (0) = 0 
(d) f(x) is increasing on (0, ©). 

Define g(x) = f(x)/x for all x in (0, 0) and prove that g is increasing on (0, 0). 
Evaluate 

. 1 — cos x? 

(a) iim x® sin x 
(b) Jim x 

(The functions sin x, cos x, logx and e* are defined in Chapter XI.) 

Suppose fis defined on [a, b] and c ¢ (a, b) and suppose /’ exists in an open interval 
containing c and that (/’)'(c) exists. Show that 


lim f(c + 2h) — alte aa te FY) 

Give an example to show that the limit above may exist even though /’(c) does not exist. 

Let f be a function on (a, 5) such that f’ is bounded on (a, 5b). Prove that there exists c # 0 such 
that g(x) =x + cf(x) is one to one. 

Suppose that fis nonnegative and f” exists on (0, 1). Suppose also that there exist points c # d 
in (0, 1) such that f(c) = 0 = f(d). Prove that f"(x) = 0 for some x ¢ (0, 1). 


50. Taylor's Theorem 


In this section we look at the problem of approximating a real-valued function f by a polynomial 
function P. That is, given fon (a, b), find a polynomial P such that |f(x) — P(x)| 1s small for all x in (a, 
b). Of course, there are functions f where it is impossible to find P as above, but we shall develop a 
method applying to certain types of functions f, which produces a polynomial P, where we have some 
information about the accuracy of the approximation. 


Definition 50.1 Let f be a real-valued function on (a, 5). f is the function on a subset of (a, b) 
defined by 


ff) = f'(x) — with domain f™ = {x & (a, 5) | f(x) exists} 


f” is the function 
LOX) = (FOX) with domain f® = {x (a, ) | (f(x) exists} 


f, f, f©, ... are defined similarly as the successive derivatives of f on (a, b). For convenience we 
define f(x) = f(x) for all x in (a, b). 


We always have @,4)> domain f> domain f@>-+:> domain fM>-+:- 


Definition 50.2 A real-valued function f is said to be of class C" on (a, b) if f(x) exists and is 
continuous for all x in (a, b). Clearly, if fis of class C”, then f must be of classes C”', C’*,..., C'. If 
fis of class C” for all positive integers n, then fis said to be of class C”. 

Let fec" on (a, Db) and let x ¢ (a, b). Among all the polynomials of degree n, there is exactly one 
polynomial P,, such that 


PMc) = fc) for k=0,1,...,7 (50.1) 
We call this polynomial the nth degree Taylor polynomial for f at c. Writing P(x) as 


P(x) = Ay + Ay(x — ¢) + Ay(x — 0)? +--+ + A,X — 0)" (50.2) 


and using (50.1), we find that 


@n) 
Ay = fle), A; = fc), -..,4, = a 
Therefore the nth degree Taylor polynomial for fat c is 
(2) n) 
PA) = fle) + F(x — 0) +O — 0) + 4¢§ FO - op (50.3) 


We see that P_ (c) =f(c). We now ask the question: How good an approximation is P(x) to f(x) for all 
x in (a, b)? Since we are concerned with the size of f(x) — P(x) on (a, b), we estimate this difference 
in the following theorem. 


Theorem 50.3 (Taylor's Theorem) Let fe ¢**! on (a, b), and let c and d be any points in (a, b). 
Then there exists a point t between c and d such that 


(+1) 
fd) = P,(d) + ie @- (50.4) 


where P, is the nth degree Taylor polynomial for fat c. 
The number ¢ in (50.4) depends on both c and d, but the importance of (50.4) is that if 


FOr) 
(z+ 1)! 


is small for a// t in some interval J < (a, b) with c «J, then we see that since 


Ca Yt) ¥ 
(a + 1)! a =r (50.5) 


|f(@) — P,(4)| = 


we can say that |f(d) — P_(d)| is small for all d in the interval J. 


Proof. Let M be the number defined by the formula 


f(a) = P,{d) + M(d - ¢)"*? 


(50.6) 
and define g(x) = f(x) — P,(x) — M(x — ¢)"** __ for all x in @, 5) 
We must show that there exists a number t between c and d such that f(t) = (n + 1)!M. 
We know p#* >) = 0 for all x in (a, b) by definition; so (50.6) gives 
gD) = fOFYQx) — (n+ IM for all x in (@, 8) (50.7) 


Therefore, our proof will be complete if we can find a number ¢ between c and d such that g(t) = 
0. Since pc) = sc) fork =0, 1, 2,...,n, we have 


gle) = g%e) =-++= g%e) = 0 


Our choice of M shows that g(d) = 0. But since g(d) = 0 and g(c) = 0, the mean-value theorem states 
there is a number f, between c and d such that g(t,) = 0. Now g(¢,) = 0 and g(c) = 0 implies by 
the mean-value theorem applied to g“” that there exists a number t, between t, and c with g®(t,) = 0. 
After n + 1 such steps, we arrive at the conclusion that there is a number ¢,,, between ¢, and c such 
that g°"(¢,,,) =0. By construction ¢,,, is between c and d; so let t = ¢,,,, and our proof is complete. 


We now give a simple example to demonstrate the way Theorem 50.3 may be used to determine a 
polynomial approximation of a given function. 


Example. Find a polynomial P such that 


for all x in (100,102) 


, 1 
P(x) — 5) < 79,000 


Let us use the Taylor polynomials expanded about c = 101, to find the desired P. By our note above 
we look at f(x) = 1/x and investigate 


(ut 1) 
; re ne for all ¢ in (100,102) 
But SOME) (= 1G $I Or 


nw f — Tyrie —(ar2 
+l! (n+)! ore 


SO fern) 
(n + 1)! 


Now |d — cl"! =|d—- 101/"' < 1"! = 1 for all din (100, 102). By Theorem 50.3 for n = 1, we have for 
each d in (100, 102), there is a number ¢, in (100, 102) such that 


ws [ft] @72) = ice for all ¢ in (100,102) 


(1+1) 
L@ — Pa =| © 


1 i 
i+1i 
(1 + 1)! eee! 


< Goo? | = 7,000,000 


(101 1 I 
P(x) = f(101) + f ¢ 2 es 161) = To ~ Gon? & ~ 100 


_-2 __} 
= 101 ~ (@ony~ 


and by the above we know that |1/x — P,(x)| < 10° for all x in (100, 102), which is an even better 
approximation than we had set out for. 


Exercises 


50.1 Find a polynomial P which approximates the function f(x) =./x within 10° on the interval (4, 
5). 


50.2 Sketch the graphs of the functions f(x) = 1/(1 + x’) and P,(x), P,(x), and P(x), the Taylor 
polynomials for f expanded at c = 0. 


50.3 Let fe c**! on (a, b), let fe, a] c (a, 8), and let p be an integer, 1 <p <n+ 1. Let 


Fe) = fa) — 3, oe 


and 


Foy — (6 = =) Fe) 


Apply Rolle's theorem to G on [c, d] to obtain 


sa)= % FO a-o +R, 


where R, = £E* VEE — t)"**~"(d — co} for some 
* Pla!) 


101 1 1 
P(x) = f(101) + oo (x ~ 101) = Ip — Gonz & — 10D 


ein’ 
= 101 ~ @ory~ 
This formula for R, is called Schémilch‘s form of the remainder for Taylor’s series. 


Show that if p =n + 1, we obtain Theorem 50.3. This formula for R, is called Lagrange ‘s 
form of the remainder. For p = 1, we obtain Cauchy s form of the remainder. Show that if 
{(d — x)/(d — c)}? 1s replaced by any function G where G(c) = 1 and G(d) = 0 additional 
forms of the remainder result. Obtain additional formulas for the remainder. 


50.4 
50.5 


50.6 


Show that if = 0 in Taylor's theorem, we obtain the mean-value theorem. 
Derive Leibniz's formula: If = fg and fand g are n-times differentiable, then 
Df) = 2, (Fe ae—™ 


k=0 


where D” denotes the nth derivative. 
Suppose that /” exists on [0, 1] and that (0) = 0 = f(1). Suppose also that |f’(x)| < K for (x) 
exists at some c € (0, 1). Prove that | fay] < x/4 and that |/(x)| < K/2 for (c) exists at some x € 


[0, 1]). 


IX 


The Riemann-Stieltjes Integral 


The Riemann integral solves the problem of defining the area under the graph of a continuous function 
f defined on a closed interval [a, b]. 

Consider the function f(x) = x? on [1, 2]. (See Figure IX.1.) We may approximate the area under / 
from below by choosing a finite set of numbers | =x) <x, <>: + > <x, =2 and computing the sum 


cis 
¥ mx, — X41) 
i=1 


where m, is the minimum of f on the interval [x,,, x,], fori =1,..., a. In this case, m, = f(x,,). For 
example, if we choose the points | < } < } < 2, we obtain the sum 


Ld + G44 9-4 = FF = 185 


This sum is the area of the rectangles in Figure IX.2. 
In a similar way, we may approximate the area under f from above by choosing a finite set of 


numbers | =x,<x,<:° ++ <x,=2 and computing the sum 
2, M(x; — Xi-1) 
where M, is the maximum of f on the interval [x,_,, x,], fori=1,...,. One can show that the number 


3 has the property that 


: mx; — X;-1) S $< y Mix; — X;-1) 
t=] F=1 


for every set of numbers | =x, <x,<-: +: + <x,=2. Moreover, by choosing the points 1 =x, <x,<- - 
* <x, =2 close enough together, the upper 


| 
| 
| 
| 
| 
| 
I 
I 
| 
1 
I 
| 

I 
| 


Figure IX.1 


and lower approximations can be made as close to 3 as we like. Thus, it is reasonable to define the 
area under the curve to be #. 

What we have done 1s average the function f over an interval [a, b] weighted by the length of the 
subintervals [x,,, x,]. The Riemann-Stieltjes integral generalizes this process by allowing weights 
other than length. This more general integral, which includes the Riemann integral as a special case, 
has many applications as, for example, in the theory of probability. 


51. Riemann-Stieltjes Integration with Respect to an Increasing Integrator 


We begin with some definitions. 


Definition 51.1 Let [a, b] be a closed interval. A partition P of [a, b] is a finite set {x),x,,...,x,} 
of real numbers such that 


a= Xp < xX, <---cxy=b 
The closed intervals [x,,, x,] fori=1,...,n are called the component intervals of the partition P. 


Definition 51.2. Let fbe a bounded function on [a, 5], let a be an increasing function on [a, b], and 
let P = {x ,X,,...,,} be a partition of [a, b]. 


1 3 § 2 
Figure IX.2 


The upper sum of f with respect to a for the partition P is the sum 


UL P) = Mies) — of, 


as M, = lub (fC) |x € bei, x} 
fori=1,...,n. The /ower sum of f with respect to a for the partition P is the sum 
L(f, P) = 2, mifa(x;) — o(x;-1)] 
where 
m, = gib { f(x) | x € [x;-1, x,]} 
fori=1,...,7. 


We will often abbreviate a(x,)—-a(x,,) to Aa, The number Aa, is the “weight” assigned to the 
component interval [x,,, x,]. The assumption that a is increasing is equivalent to assuming that the 
weight assigned to each component interval is nonnegative. In Section 53 we will consider arbitrary 
(not necessarily nonnegative) weights. If a(x) = x, the weight assigned to a component interval [x,_,, 
x,| 1S a(x,)-a(x,_,) = x; — x,,, which is the length of the interval [x,,, x,]. Thus our definitions will 
include the Riemann integral as a special case. 

Let fand a be as in Definition 51.2. Suppose that m < f(x) < M for all x in[a, b]. Let P= {x9,x,,.. 
.,x,} be a partition of [a, b]. Then 


mia(b) — a(a)] = > m Ad; = M Aa; = Uf, P) 


Thus the set of upper sums for f with respect to a is bounded below by m[a(b) — a(a)]. Similarly, the 


set of lower sums for f with respect to a is bounded above by M[a(b) — a(a)]. This justifies our next 
definition. 


Definition 51.3. Let f be a bounded function on [a, 5] and let a be an increasing function on [a, 5]. 
Let &(£) denote the set of upper (lower) sums for f with respect to a. 
The upper Riemann-Stieltjes integral of f with respect to a on [a, b] 1s the number 


yo 
| fda = glb& 
The lower Riemann-Stieltjes integral of f with respect to a on [a, b] is the number 
b 
| fda = lub # 
We say that fis Riemann-Stieltjes integrable with respect to a on [a, b], if 
Pb b 
| fdi= | fda 
and in this case we define the Riemann-Stieltjes integral of f with respect to a on [a, b|, denoted 
b 'b 
{ fda or | I(x) da(x) 
to be the common value Z%: v%a. We let R,[a, b] denote the set of functions which are Riemann- 
Stieltjes integrable with respect to a on [a, b]. 


For the special case, f(x) = x, we let R,[a, b] = R[a, b]. If f¢ 414 4], we say that fis Riemann 
integrable on [a, b]. The integral of a function fin R[a, b] is denoted 


i xr Or { T(x) dx 


Examples. (a) If a(x) =k for all x in[a, b] and fis any bounded function on [a, 5], then every upper 
and lower sum of fis 0, and thus 


(verify). Therefore f€ #[@, 4] and Sn. fdx = 0, 
(b) Ifa is an increasing function on [a, b] and f(x) =< for all x in [a, 5], 
then every upper and lower sum for fis equal to k[a(b) — a(a)]. Thus f¢ #.[4; 4] and 


| idx = k[a(b) — «(a)] 


(c) Let 


I if x is rational 
I(x) = 


Q if x is irrational 


for x in[0, 1]. Let a(x) =x on [0, 1]. Then every upper sum for fis 1 and every lower sum for fis 0. 
Therefore 


and thus /¢ 2[0, 1]. 

We next derive Riemann's condition (Theorem 51.8) which gives a necessary and sufficient 
condition that f¢ #,[¢, 4], In 51.5 to 51.7, f is a bounded function on [a, b] and a is an increasing 
function on [a, 5]. 


Definition 51.4 IfS and P are partitions of [a, b] and P < S, we say that S is a refinement of P. 
Lemma 51.5 If P and S are partitions of [a, b] and Sis a refinement of P, 
US) < UGZP) and Lf, S) = Lf, P) 


Proof. First suppose that S contains one more point than P. Let P = {x x,,...,%x,}. Then 
S = Pu {x*}, Suppose ** €Py-1 J, Let 


Mj = lub {f(x) | xe [x;-1, 2°} 
M}* = lub (f(x) | x & [x*, x;)} 


Then “7 = Mj and 47" = Mj, and we have 


UG,P)= = M, Ac; 
1 


j= 


= oy M;, Aw, + M[a(x*) — a(x;-1)] 


+ Milax,) — a(x] + 5 Mbt 


ini 
= p? M, Ao, + My[a(x*) — afx;_ I 
=1 


+MF*[a(x;) — a(x*)]) + YM, Ao, 
i=jt+1 
= UF, S) 
If S contains k more points than P, we repeat the above argument k times to conclude that U(f, S) < 


U(f, P). 
Similarly, L(f, S) > L(f; P). m 


Corollary 51.6 If P and S are partitions of [a, b], then 
L(f, S) = UG, P) 
Proof. LetT =PwuS. Then 71s a refinement of both P and S; so by Lemma 51.5, we have 


Corollary 51.7 Lf, S) < Lf, T) < Us, T) < Uf, P) 


[sae s | fae 


Proof. Let P be a partition of [a, 6]. Then for any partition S of [a, b], we have (by Corollary 
51.6) 


L(f, S) < Uf, P) 


Therefore, U(f, P) is an upper bound for the set of lower sums, and thus 


[fee < U(f, P) 


for any partition P of [a, 6]. Thus Sef is a lower bound for the set of upper sums and hence 


b Tb a 
| fdes | fda 
Theorem 51.8 (Riemann's Condition) “et f bea bounded function on [a, b] and let a be an 
increasing function on [a, b]. Then f¢ #.[¢, 4] if and only if for every ¢ > 0, there exists a partition P of 
[a, b] such that 


U(LP)—-UO,P)<e 


Proof. Suppose f¢ #,[4; 4], Let g > 0. There exist partitions S and T of [a, b] such that 


i is g 


[fam —$<UKn US) <| fae +5 


Let P= SUT. By Lemma 51.5, 


UZ, P) — LY, P) s UG, S) — Lf, T) 


(hsm) (Tras) 


since 7 6 
{ft = | Ff du. 


Now suppose the condition holds. Let g > 0. There exists a partition P of [a, b] such that 


Uf, P)- Lf, P)<e 


Thus [tae- [rae < UA P)—- LAP) <e 


Therefore, using Corollary 51.7, we have 
. b 
0< [ra [fax << 


for every ¢ > 0. It follows that Jafda = fof dx and hence S¢ 2.14, 5] jy 


Example 51.9 Let [a, 5] be a closed interval and let c € (a, b). Let k, <k, and define 


Ky as xe 
o(x) = 
k ae ae 


(The value of (¢) €[k,, £2] is immaterial.) (See Figure 51.1.) Let f be a bounded function on [a, b] 
which is continuous at c. We use our preceding results to show that f¢ #,[¢, 4] and 


| fae = fle), —Ks) 


Let g > 0. Since fis continuous at c, there exist points x, and x, with 


Figure 51.1 


a<x,<c <x, <b such that if* €[1, %2], then 
& & 
f(e) = 3k, = k,) < f(x) < f(c) + i(k; = k,) 


Let P= {a,x,, x,, b}. The numbers m, and M, denote the glb and lub, respectively, of fon the interval 
[x,, X>]; thus 


FO) — 3G Ry $2 SMe SIO + EE 


N P 
~ U(f, P) = Mfo(x.) — a(x,)] = Ma(k, — 1) = f(z — Ki) + 3 


Therefore, 2e 
UZ,P)-LGP)< 3 <8 


and by Theorem 51.8, f¢ &ala, 4), 
Now 


[sr < U(f,P) < fleke — ky) +5 
hence » e 
[fe < flees = hs) +5 


for every g > 0. Therefore, 


[fae S fle), — ky) 
Similarly, [fae > f(ci(kz — k,) 


and thus | fda = f(e\k, — k;) 


We are now ina position to prove that a continuous function is Riemann-Stieltjes integrable. 


Theorem 51.10 Iffis continuous on [a, b] and a is increasing on [a, b], then /¢ #.I¢, 4], 


Proof. Ifa 1s constant on [a, 5], there is nothing to prove; so assume a(a) < a(b). Let g > 0. Since 
f is continuous on [a, b], fis uniformly continuous on [a, b] (Corollary 44.6); so there exists 6 > 0 
such that if |s — ¢| <0, 
then 


If) — f@)| < CORSO 


Let P= {Xo,X,,...,X,} be a partition such thatx,—x,_,<d0fori=1,...,n. Then 


€ 


MS Falby = ota 


fori=1,..., (verify). Thus 


UCP) — Lf, P) = ¥ (Mi — mydx, 


& 
= Faby — ata, 


By Theorem 51.8, f€ #21@, 5], gy 


The remainder of this section is devoted to deriving properties of the set R,[a, b] where a is an 
increasing function on [a, b]. 


Theorem 51.11 Let @ be an increasing function on [a, 5]. If f¢ #14; 4], then f¢ &.le, 4] for every 
closed subinterval [c, d] of [a, b| and 


| fds = | fda + [ f da 


for all c in (a, 5). 


Proof. Letce(a, b). Let P be a partition of [a, b] and let ?* = Pv fe}. Then 7: = P* 9 [4, ¢] and 
P, = P* 0 [e, 4] are partitions of [a, c] and [c, b], respectively. Now 


Uf, P) = US, P*) = UP) + UY Ps) = [fax | fa 


It follows that 


Similarly, i 
Therefore, 


Thus b 


and hence f€ &,[2, c] % #,{c, 6]. Furthermore, 


[fa - [sae + [fa 


Let [c, d] be a closed subinterval of [a, b]. By the above result f¢ 4.1, 4] 
of the above result yields f¢ 2.[c, 2]. yy 


and another application 


Theorem 51.12 Let fbe a bounded function on [a, 5] and let a be an increasing function on [a, 
b]. Suppose that m < f(x) <M for all x in [a, b]. If f¢ 4.12, 4] and g is continuous on [m, M], then 


gfe R,la, b). 


Proof. Leth =ge fand let k satisfy k > |g(a)| for all ¢ in [m, M]. Let ¢ > 0. Since g is uniformly 
continuous on [m, M], there exists 6, 0 <6 < ¢/(2k + a(b) — a(a)) such that if |s — ¢] < 6, then 


é 
lols) — 9 < a — ata) 


Since fe @,[a, b], by Theorem 51.8, there exists a partition P= {X,X),..., 


Uf, P) — Lf, P) < &# 


M, = lub {f(x) | xe [x;-1, x} 
Let m, = glb { f(x) | xe [x;_1, xJ} 

M* = lub {h(x) | x © [x;-1, x} 

me = glb {h(x) | x € [x;_1, x} 
fori=1,...,n. Let 


A= fi|l<i<nand M; — m, < 6} 


B= {i|l sis anand M, — m, = 5} 


If i ¢ A, we have by inequality (51.1) that M* — mj < ¢/(2k + a(b) — a(a)). 


Ifi e B, we have Mf — mf < 2k. Now 


5 Aa, < > (M,; — m)Aa, s ¥ (M; — mda; 
ie i=1 


fea 


= U4 P)- LU,P) < & 


and it follows that 


yy) Aa; <6 


ieB 


Therefore, 


(51.1) 


x,} of [a, b] such that 


U(h, P) — Lh, P) = ¥ (Mit — mia, 


= >) (MF — maa, + ¥ (MF — mPAg, 
ieA ieB 


& 
= ak + ab) = a(a) D, Aas + 2k 2, Aa; 


& n 
= Fay ESE » Aa; + 2k6 


& 
< FEF a — aa OO) — Ca) 


e 
2k + a(b) — ofa) ? 


+ 2k 
By Theorem 51.8, #€ #.[4, 6], y 
Theorem 51.13 Let a be an increasing function on [a, b]. If fand g are in R,[a, b] and c ¢ R, then 
b 
(i) cfe Ra, 5] and | efda=c I f du. 
; b fa] b 
(ii) f+ g eR fa, 8] and | (f+ g) da = | fda + | g dx. 


(iii) f-g ¢ R,[a, B). 


& 


dx < ; dex, 
qi aee eed < {lode 


(v) [fl €R,[a, b] and 


[fae 


< | ide 


Proof. (i) Let g(x) = cx. By Theorem 51.12, g ° f(x) = cf(x) is in R,[a, b]. Suppose c > 0. Let P 
be a partition of [a, 5]. Then 


U(cf, P) = cUUf, P) =e [sae 
and it follows that 


[fae c | fa 


Similarly, 


| a < cf fa 


Therefore, 


[ cfda =c [fae 


The case c < 0 is treated in a similar way. 
(i1) For any partition P of [a, b], we have 


Lf, P) + Lg, P) < Kf +9, P) s U(f+g9,P) s UY, P) + UG, P) (verify). 
Let g > 0. By Theorem 51.8, there exist partitions S and 7 of [a, b] such that 


UL, S)— Lf, 8) <5 and U@,T) - Lg, 7) <3 

Let P = SUT. Then we have 
US + 9,P)-Lf+9,P)<5+5=8 

By Theorem 51.8, f+ 9 € 2,1, 4], Also 
. 


Uf, P) < UES) < LYS) +5 [ fae +§ 


Similarly, g 


U(g, P) < [9 a + 5 
Therefore, 
[+ g)da < U(f +g, P) <s UU, P) + Ug, P) 


b b 
< [fat | ode +s 
Since g > 0 was arbitrary, we have 


[us g) da < [fu + [9a 


Similarly, 


[+ 9) da > [fae + [oa 


and therefore 
b ‘b 'b 
| (f+ g) dx = [fae + | g da 


(iii) It follows from Theorem 51.12 that if f¢ #14, 4], then /? € &,la, 4} for if f¢ #14, 4], since g(x) = 
x? is continuous, we have 9° =f? € &,{a, 4], 

Now let £9¢2.1a,4], By parts (i) and (ii), f+9.f-g9¢,/2,5]. By the result above 
(f+ 9), (f — 9)’ € &,[a, b).. By parts (i) and (ii), 


fg =41+9¥ -UC- 971 


is in R,[a, 5]. 
(iv) Suppose f¢ #,[4, 4] and f(x) > 0 for x in [a, b]. Let P be a partition of [a, b]. Then 


[fa Lf, P) 29 


If f, 9 € Bla, 6] and g(x) > f(x) for x in [a, b], then g(x) — f(x) > 0 for x in [a, b] and by our result 
above 


[@-Na&z0 
By parts (1) and (11) 


Kc -f\de = [9a . [fa 


and therefore 


7) t 
[eae | fax 


(v) Since g(x) = |x| is continuous, 9 °f = If! € &.[4, 6], Define c by the equation 


e [fas = 


[fe 


(The number c is either 1 or — 1.) Now cf(x) < |Ax)| for all x in [a, 5]; so by part (iv) we have 
17) b 
| cf da < | lf | do 
Using part (1) we have 


ty ti) 'b Db a 
[fra ~ | sa = | cf da < | | f| do 
Theorem 51.14 (Mean-Value Theorem of the Intégral) ~““If fis continuous on [a, 5] and a is 
increasing on [a, b], there exists c ¢ (a, b) such that 


'b 
[fe = flo) — ofa 
Proof. If a(b) = a(a), then any value of c in[a, 5] gives the desired conclusion. Suppose a(b) > 


a(a). By Theorem 34.4, f attains its maximum M and minimum m on [a, b]. For the partition P = {a, 
b} we have 


& : 
mfa(b) — a(a)] = Lf, P) s [s de <= U(f, P) = M[a(b) — a(a)] 


rp 


Therefore, f du 


™< Th) —a@ <™ 


By the intermediate-value theorem (Theorem 45.6), there exists c in[a, b] such that 


& 


Sf da | 
fe) = a(b) — a(a) 
Exercises 


In Exercises 51.1 to 51.5 fis a bounded function on [a, b] and a is an increasing function on [a, b]. 
51.1 Prove that if P is a partition of [a, b], then L(f, P) < U(f, P). 
51.2 Prove that if P and S are partitions of [a, b] and S is a refinement of P, then L(f, S) = L(f, P), 
thus completing the proof of Lemma 51.5. 


51.3. Prove that f¢ #,[¢, 4] if and only if for every g > 0, there exist partitions P and S' of [a, b] such 
that 


UU, P) — LU, S) <e 
51.4 Letce(a, bd). Prove that 
{ fde= ip fda + I. fdu and 8 fin [fe a [fae 


51.5 Prove that 


[fda = —[(-f) da 


51.6 Use the results of this section to prove that 


[xa =5 and | dx = 5 
51.7 Let 
BS Doe ok, oa | 
= 12 4 5 l<x<2 
Compute J gee, 
51.8 Leta be an increasing function on [a, b] and let c < 0. Prove that if f¢ #.14, 4], then cf¢ &[4, 4] 
and 


fi cfda =e fd 


thus completing the proof of Theorem 51.13(1). 
51.9 Leta be an increasing function on [a, b]. Prove that if 4 g € #.1¢, 4], then 


[P+ ada = [fae + fo dx 


thus completing the proof of Theorem 51.13(i1). 
51.10 (a) Prove that if fis a continuous function on [a, 5], there exists a point c in (a, b) such that 


[FG dx = f(b — a) 
(b) Give an example to show that for an arbitrary increasing function a on [a, 5], part (a) 


may fail. 
51.11 Prove that ifs a continuous nonnegative function on [a, b] and 


[s (x) dx =0, then f(x) = 0 for all x in [@, 5). 


51.12 Let 
= _ fo fOsx<l 
a) = Sa) = {1 ifl<ox<2 
{0 ifO<x<1 
ax) = {; ifl<x<2 
2 
(a) Is £€ 2.{0, 2]? If so, compute J Pid 


2 
(b) Is ¢ © 2.0, 2]? If so, compute \,2 a 
(c) Do (a) and (b) above with a(x) =x. 
51.13 Leta, and a, be increasing functions on [a, b]. 
(a) Prove that a, + a, is increasing on [a, 5]. 
(b) Let #© #a,[4 4] 9 #.,[4, 1. Prove that £€ #2, +«:14, 6] and 


[fae + in [ fear + [* fdas 


51.14 Leta be an increasing function on [a, b] and let f and g be bounded functions on [a, 5]. 
Prove that 


[fda + [oda < |S + 9) de < [f+ oda < [fee +f 9 de 


51.15 Leta be an increasing function on [a, b]. Prove that if fg © #.1@, 4], then max {f, g} and min 
{f, g} are in R [a, b]. 

51.16 Leta be an increasing function on [a, b]. Let f¢ 4.14, 4] and suppose that for some positive 
number M, |f(x)|>M for all x in [a, b]. Prove that 1/f¢ #.l, 4), 

51.17 Let fbe a positive continuous function on [a, b], and let / be the maximum of fon [a, 5]. 
Prove that 


i [ora] = 


51.18 Give an example of an increasing function a on [a, b] and a bounded function f on [a, 5] 


such that || € #.[4, 5], but f¢ #,[a, 6], 
51.19 Prove that iff is an increasing function on [a, b], then f¢ #,[¢, 4], 
51.20 Letfbe a bounded function on [a, b]. Prove that any of the following conditions implies that 
Se &f[a, 8). 
(a) fhas a limit at each point of [a, 5]. 
(b) f has a left-hand and a right-hand limit at each point of (a, 5). 
(c) fhas a left-hand limit at each point of (a, 5]. 


52. Riemann-Stieltjes Sums 


We begin with a definition. 


Definition 52.1 Let fand a be bounded functions on [a, b]. Let P= {x),x,,...,x,} be a partition of 
[a, b]. Let T= {t,, t,,..., ¢,} where &©[*i-1.*) fori=1,...,2. The sum 
Pi F(t,) Aq, 


I 


i=1 


is called the Riemann-Stieltjes sum for f with respect to a for the partition P and points T. We 
denote this sum as 


S(f, P, T} 
Let f, a, and P be as in Definition 52.1, and assume that a is increasing. Clearly, 
Lf, P) < S(f, P, T) < UU, P) 


for any points 7. Thus if the upper and lower sums approximate the integral, we would expect that the 
Riemann-Stieltjes sums would also approximate the integral. The next theorem shows that this is the 
case. 


Theorem 52.2 Let f be a bounded function on [a, b] and let a be an increasing function on [a, 5]. 
Then f¢ #,[, 5] if and only if there exists a number J having the property that for every ¢ > 0, there 
exists a partition P such that if P* is a refinement of ?(P* > ?), then 


Ss(ifP*, 7) —i<e 


for any points 7. 
If f¢ 2,[4, 5], the number J is equal to Jaf a. 


Proof. Suppose f¢ #,[4; 4], Let g > 0. By Theorem 51.8, there exists a partition P such that 
U(f,P)- LP) <e 


Let P’ be a refinement of P. Then 


Uf P*) -— Li, P*) < OO P)—- LA P)<e 


Now Lf, P*) = Sf, P*, T) < UC, P*) 
and . 

L{f, P*) < | fda < U(f, P*) 
and hence 


: for any points 7 


14) 
sus P*,T) = | fas < 
It follows that J = Sof de, 
Now suppose the condition holds. We may assume a(b) > a(a). Let g > 0. There exists a partition P 
= {Xo X1,--->X,} of La, b] such that 
ISU, P,T)-N<G 
for all points 7. For eachi, 1 <i <n, there exists #7 © Pi-1, *d such that 


Mi ~ aeioy = aay <0) 


Thus uy.) b= ¥ (m1 - qa wai) < 3, fda 
U(f, P) - 5s Sf, P, T*) 
Similarly, there exist points 7” such that 
SUP, T) < Lf, P) +5 
Therefore, 
UP) - UG P) = [SUR T) +5] +[—SUPT™) +3 
< |S(f, P, T*) — SU, P, T™)| + 5 
< |SGP,.T) — i+ ISGP, T*) -— 1+ 5 
<faheins 


By Theorem 51.8, f€ #a1@, 5], gy 


The condition “P* > P” in Theorem 52.2 is analogous to the condition “n > N”’ in the definition of 
the limit of a sequence. These concepts can be treated under a unified theory, the theory of directed 
sets or filters. (See Kelley, 1955, Chapter 2.) 

Theorem 52.2 shows that refining partitions is a way of forcing convergence of Riemann-Stieltjes 
sums. Another way to describe convergence of Riemann-Stieltjes sums is given in the next definition. 


Definition 52.3 Let P= {x),x,,...,x,} bea partition of [a, b]. We define 
norm P = max {|x, — x,;_,|:1 < i <n} 
Let fand a be bounded functions on [a, 5]. We say that 


lim S(f,P,T)=I 


horm PO 


if for every ¢ > 0, there exists 6 > 0 such that for any partition P of [a, b] with norm P < 6 and for any 
points 7, we have 


ISGP, T)- I] <e 


We cannot prove a theorem analogous to Theorem 52.2 for the kind of convergence described in 
Definition 52.3. That 1s, convergence of Riemann-Stieltjes sums as described in Definition 52.3 1s not 


equivalent to the existence of the Riemann-Stieltjes integral. For example, let 
0 if-—-l<sx<0 
1 f0<exel 


F) -| 


and 0 if-l<x<0 
a(x) = 
1 wo<x<sil 


Let P = {-l, 0, 1}. Then U(f;, P) = L(f; P) = 1, and thus f¢ 4{—-1, 1]. However, lim,,,.. po S(f P, T) 
does not exist. 
If P* > P = {-1,0, 1}, then 


1 = Lf, P) s LU, P*) < SU, P*, T) s UU, P*) s UP) =1 


and therefore S(f; P’, T) = 1. Thus there are partitions P” of [a, b] with arbitrarily small norm such 
that S(f; P*, T) = 1. On the other hand, if 


pt -2 herd =e 


ti it a 
and we choose t = —(1/n) in the interval [—(1/n), 1/n], we have 


S(f, P*,T) =0 


and norm P* = 2/n. Thus there are partitions P” of [a, b] with arbitrarily small norm such that S(f; P’, 
T) = 0. It follows that lim,,... p49 SG P, T) does not exist. 
In spite of the previous example, we do have the following two results. 


Theorem 52.4 Let fbe a bounded function on [a, 5] and let a be an increasing function on [a, 5b]. If 
lim, orm poo SU, P, T) exists, then S€ #.1¢, 4] and 


lim S(f,P,T) = [fa 


norm P=>0 a 
Proof. Let, > 0. There exists 6 > 0 such that if norm P < 0, then 
ISG, P,T) -—I| <e 
Let P be a partition of [a, b] such that norm P < 6. If P* > P, then norm P” < 6 and thus 
IS, P*, T) — I] <e 
By Theorem 52.2, f¢ #219, 4] and [= Saf de. my 


Theorem52.5 Let a be an increasing function on [a, b] and suppose that /¢ #.[¢, 4], If either for a 
is continuous on [a, b], then 


(‘b 
| f= lim S(f,P,T) 


norm P+0 
Proof. First suppose that fis continuous on [a, b]. We may assume that a(b) > a(a). Let g > 0. 

Since fis continuous on [a, b], fis uniformly continuous on [a, b]. Thus, there exists 6 > 0 such that if 
ls — t| <0, then 

| r ) t Pe 

f(s =i )I < 2[a(b) = a(a)) 
Let P= {x),X,,...,,} be a partition with norm P < o. Let 

Sf, P, T) = 2 S(tpAa; 

be a Riemann-Stieltjes sum. By Theorems 51.11 and 51.14, 


[Lraem 5 sae= Bp 


i=1 


* . 
where #7 © Pi-1, i) fori=1,...,n. Therefore, 


sue.) - [_fas| - 


> treed - fae, 
< YS Att — fe Aa 


re 


< Fey = at) 


H b 
aa lim S(f,P,T) = | fide 


norm P--0 


Now suppose that a is continuous on [a, b]. We first assume that f(x) > 0 for x in [a, b]. Let g > 0. 
There exists a partition O = {y, y,,...,¥,} of [a, b] such that 


b te 
Uf) < [fant § 


Let M = lub{f(x)| € [2, 4}}. Now a is uniformly continuous on [a, b] and thus there exists 6’ > 0 such 


that it P = {X53 X45-2 25 > X;} is a partition of [a, 5] with norm P < 6’, we have 
€ 
Aa, < 4Mn 
fori=1,...,/7. Let A denote the set of integers i for which | <i <j and (x,_,, x,) contains a point of 
Q. Let 


B=(,...,/}4 


UU, P) = M,Aa, + YM Aq, 
igA teB 
Now < (n — DM + US, Q) 
» & 
< | fae + 3 


Now let fbe any function in ®,[a, b] and let g > 0. Choose a number & such that f(x) + k > 0 on [a, 
b]. By the above argument, there exists 0, > 0 such that if norm P < 0,, then 


U(f+k, P)< [a+ Ke) dos + 5 
Since U(f'+ k, P) = U(f, P) + k(b — a) and 

b b 

| (f+ de = | fae + ko — 4) 


we find that 


UU, P) < | fdx +5 


ifnorm P < 0,. 
Applying the above argument to —f, we find that there exists 0, > 0 such that if norm P < 6,, then 


U(-f, P) < (—f) du + ; 
Since U(-f, P) =—-L(f, P), we conclude that 
7 E 
Lf, P) > | fda —- 3 


ifnorm P < 0,. Let 6 = min {0,, 0,}. Ifnorm P < 0, then 


[fax 5 <UL) s SUP.7) s UEP) < [fax +5 


and thus sunny — [pe 


<€ 


b 
lim SCF, P. T) = ( f dx 


Therefore, "| fda = | fdu+ | fda 


Corollary 52.6 IfJ« , then 


lim S(f, P,T)= [f 


norm P+0 a 


Proof. Since a(x) =x is continuous, the conclusion follows immediately from Theorem 52.5. m 


Exercises 
52.1 Let fe #0, 1]. Prove that 


tim 2S (G)5= fo 


52.2 Using Definition 52.3 to define what is meant by f being Riemann-Stieltjes integrable with 
respect to a on[a, b], which we shall write /¢ &5la, 4], prove 
(a) If fg € RSla, 4), then f +- g ¢ RS{a, b) and 


[r+ ade = [fda +f? g dx 


(b) If fe &Sl[e, 4], then c fe RSfa, 6] and 


flames 


(c) If fg RSla, 4) and f(x) < g(x) for all x € [a, b], then 


rb 


[fee <| ode 


(d) Prove or disprove: if /€ &S[¢, 4] and a@ is increasing on [a, b], then /€ &Sle, @] for every 
subinterval [c, d] of [a, b] and 


[ae sae fie 
53. Riemann-Stieltjes Integration with Respect to an Arbitrary Integrator 


In this section we extend the definition of the Riemann-Stieltjes integral J:f4 to arbitrary (not 
necessarily increasing) functions a. Motivated by Theorem 52.2, we make the following definition. 


Definition 53.1. | Let f and a be bounded functions on [a, b]. We say that f is Riemann-Stieltjes 
integrable with respect to a on [a, b], and write f¢#.[¢, 4], if there exists a number / having the 
property that for every ¢ > 0, there exists a partition P of [a, b] such that if P* is a refinement of P ( 


p* > p), then 


IS, P*, 7) — i <e 


for any points 7. 


It can be shown (Exercise 53.4) that the number / of Definition 53.1 is unique. We denote this 
number J as Jef, By Theorem 52.2, Definition 53.1 is consistent with Definition 53.3. 
We now derive a result analogous to Theorem 51.13(i), and (11). 


Theorem 53.2 Let, g, and a be bounded functions on [a, 5] and letc € R. 


Iff g € &.la, 5), then ef, f + g € #,Ja, 6), and 
ti b Db b i) 
[G+ adem [pax + [9 a, [etd =e | fa 
Proof. Lete>0. There exists a partition P, of [a, b] such that if P* > P,, then 
a & 
sua Ps, 7 - [_fadl <5 
There exists a partition P, of [a, b] such that if P* > P,, then 


é 
<= 


& 
si, Pe, T) - | g dal <5 


If we let? = 7: V P2 and P* > P, then 
ib ‘b 
|Si/+, P*, T) (| fda + | gdx)| <e 
Therefore f+ 9 € &.[a, 4). and 
‘b 5 b 
[Ur ade =| pee + [ga 


The second equation 1s proved in a similar way. ™ 
Our next theorem demonstrates that the roles of fand a may be interchanged. 


Theorem 53.3 (Integration by Parts) Let f and a be bounded functions on [a, b]. If f¢ ala, 4), then 
%€ #,[a, 5) and 


b fi 
[£4 = Ox) — flaw(a) - [aay 
Proof. Lets > 0. There exists a partition P of [a, b] such that if P* > P, then 


scr P*, T) - [fae 


<6 


Let 
Sa, P*, T**) = Di ated — fOi-] 


t=1 


be a Riemann-Stieltjes sum for a, where P* > P. Now 
AB)a(B) — fl@e(a) = Y flxdatxd — Y fl-s)e%s-1) 
S(b)alb) — flaala) — S(a, P*, T**) 


= ¥ feedlaes) — atta + Y folate) — of) 


which is a Riemann-Stieltjes sum S(f, P’™”, T°"), where £© Far+axl4 9] and fe #-0,[4, 6] and we have 


S(e, Ps, T**) — | fw) — flaata -| aa] 


| 
<8é 
& R. If fe &,,[a, 5] a #14, 5] 


= | a — S(f, P™, T#**) 
Corollary 53.4 Let f, a,, and a, be bounded functivhs on [a, b] and let c 


then fe Rota, b] and fe R oa, [As 6] and 


[fate + a2) = [fae + [fea [, fate.) = I of dx, 


Proof. By Theorem 53.3, %» % © #4, 6). By Theorem 53.2, % + % € Ayla, 4] and 
b ti) > 
{ (a, + a.) df= | ay df + | a, af 
Again by Theorem 53.3, /€ #a;+#:[4 4] and 


| fala, +03) = f)fe,() + a,(0)] 
~ fl@la,(a) + «,(a)] - | (a, + a) df 
Boxe ORS — j t a | 
b 
- | £ex0) ~ flaye,(a) — [ ty a | 
ai] by 
= [fe + | ft 
The second equation is proved ina similar way. 


Let f and a be bounded functions on [a, b]. We consider the problem of imposing conditions on f 
and a so that f¢ #,[4, 5]. Let > 0. We must be able to find a partition P = {x,, x,,...,x,} such that if 
P* > P, we have 


SC, P*, T*) —I] <e 
In particular, we must have 
IS(f, P, T) — S(f, P*, T*)| < 22 


if P* > P. We may write 


SYP, T) - Sf, P*, T*) = ri fia) — a0%-1)] 


7 Py fCMaW,) — a(¥;-)) 


where P* = {),,,,---5,,$ and ¢, and 4* belong to the same interval [x,,, x,]. Thus we must make the 
sum 
2X LG) — FEM) — a(yi-VI (53.1) 


small. If fis continuous on [a, b], we may use the uniform continuity of fto make |/() — A small. If 
di=1 14) — &(%:-1)| is bounded for every partition P’ of [a, b], the sum (53.1) will be small. The next 
section is devoted to the study of functions a for which X¥=, |4¢;l is bounded for every partition of [a, 
b]. 


Exercises 
53.1 Prove the second equation of Theorem 53.2. 
53.2 Prove the second equation of Corollary 53.4. 
53.3° Let fand a be bounded functions on [a, b]. Prove that the following are equivalent: 
(a) fe 2,4, 5] 
(b) For every ¢ > 0, there exists a partition P of [a, b] such that if P* > P, then 


[SU, P*, T*) — SGP, <e 
(c) For every g > 0, there exists a partition P of [a, b] such that if P"", P* > P, then 
IS P**, T**) — SU, P*, T*)| <6 


53.4 Prove that the number / of Definition 53.1 is unique. 


54. Functions of Bounded Variation 


In this section we define bounded variation. Functions of bounded variation are close relatives of 
increasing functions (Theorem 54.9) and the results of this section will be used to extend the results 
of Section 51. 


Definition 54.1 Let a be a function on [a, b]. If the set of all sums 
»» |a(x,) — o(X)-1)I 


where {Xx,,X,,...,X,} 1S a partition of [a, b], is bounded, we say that a is of bounded variation on 
[a, b] and write # © 4V[a, 4), 
If% ¢ BV[¢, 5], we let 


Via = tub | ¥ las) ~ as. 


where the least upper bound is taken over all partitions {x,,x,,...,x,} of [a, b]. The number / is 
called the total variation of a on [a, b]. 
The next two theorems give examples of functions of bounded variation. 


Theorem 54.2 If a is increasing (decreasing) on [a, b], then *¢€4Vl4,4] and 
Vex = a{b) — ofa) [= aa) — afd)). 


Proof. Suppose a 1s increasing on [a, b]. (In case a is decreasing, the proof is similar.) If {x 9, x,, 
.,x,} is a partition of [a, b], we have 


D lAsul = a(8) — ata) 


and the conclusion follows immediately. ™ 


Theorem 54.3 _ If a is continuous on [a, b] and differentiable in (a, b) and a' is bounded on (a, 5), 
then # € 8V[a, 8), 


Proof. Suppose |a'(x)| < M for x in (a, b). Let {xo, x,,...,x,} be a partition of [a, b]. By the 
mean-value theorem (Theorem 49.6), we have 


Aa; = a'(t;)(x; — x;-1) 


for some 4; € (4-1, %) fori=1,...,n. Thus 
¥ baal = Yee — 41-1) < MY Gi — xia) = MO - a) 


and therefore % © 5V{a, 5], yy 
A continuous function on [a, b] is not necessarily of bounded variation on [a, b]. Let 


1 acct or 1 
: if # is an even positive integer and x = 34 
afx) = ines cana 1 
0 if wis an odd positive integer and x = P 


0 ifx =Qorx =I! 


Let a be linear in between. (See Figure 54.1.) Then @ is continuous on [0, 1], but *¢ 4/0, 1], For 


the partition 
y J i 
{0,-. n= 1" ae 15? i 
where n is an odd positive integer, we have 


«0-e(8}+4Q) + 


I WN lett , 
+ Jala] — a5 al 5 — a(1) 
a Ly fy 0 al 
SS ae eo re a 
a aa ES 


which is unbounded since the series Xn=1 1/" diverges (Corollary 24.3). Therefore « ¢ BV[O, 1], 
The next theorems show that BV[a, b| is closed under addition, multiplication by a constant, 
subtraction, and multiplication. 


Theorem 54.4 If % Be BV[a, 5) andc eR, then® + f, ce € BY[a, 6] and 


Vita + B) < Vix + VB V (eu) = fel V%x 
Proof. Let {xXo,x,,...,X,} be a partition of [a, b]. Then 


¥ lot) + Bed] — bees.) + Bora) 


< ) |Aa| + > 1AB) < Vio + Vip 
i=4 i=1 


Figure 54.1 


Therefore, % + 8, ca € BY[a, 5] and Vita + B) < Vie + VOB. 
The second equation 1s proved in a similar way. ™ 
Corollary 54.5 If % Be BV[a, 4), thens — Be BV[a, 8}. 
Proof. By Theorem 54.4, we have ¢ — 8 = @ + (—l)B¢ BV{a, 5]. 


Theorem 54.6 If % fe BV[a, 4], then «8 € BV{a, 5]. 
Proof. We first show that if % © 4V[¢, 4], then a is bounded on [a, 5]. For, taking the partition {a, x, 
bt, where a <x <b, we have 


lo(x)| — Joe(a)| < Jar) — afa)| + la(d) — of) s Vow 


and hence 
la(x)| = Vax + lofa)| 


for x in[a, b| and thus a is bounded on [a, 5]. 
Let % Be BY[a, 5), There exist numbers M, and M, such that |a(x)| < M, and |8(x)| < M, for x in [a, 


b]. Let {x 9, x,,...,X,} be a partition of [a, b]. Then 


Flax) 6(x) — a, )B(%— I 


t=] 


jo(x, )B(x,) — a(x) BOj—1) + oe) BO.) — ae;~ DBO- DI 


< Yall pil + 5 Wola dla 
<M, 


Vs + M,Vio 


Therefore, %'f ¢ BV[a, 5]. gy 


We next show that if% © 4V[4, 4], the total variation is additive over the interval. 


Theorem 54.7 If %€ 4V[¢, 4], then a is of bounded variation on any closed subinterval of [a, b] and 
ifc e (a, b), we have 


Vio = Vin + Veo 


Proof. Letce(a,b). Let P, = {xo, x,,...,x,} and P, = {%, y,,.-->, ¥,,$ be partitions of [a, c] 
and [c, b], respectively. Then /: V 2 is a partition of [a, b], and we have 


¥ Gs) ~ aCe + Y laCyd — a4 s Vee 
Thus for any partition P; = {x),x,,...,,} of[a, c], we have 
Y lee) = a(ai-)1 < Pe — Y led — aso) 
Therefore, *% © 3V[¢, ¢] and 
Vin < Vie = ¥ laCy) ~ ay-0) 
Thus for any partition P, = {y), y,,---,¥,,} of [c, b], we have 
led — ay.) s Vibe — Vie 
It follows that « € BV[e, 4] and 
Vou + Vix < Vou 


Let P= {x,,x,,...,x,} be a partition of [a, b]. Then ? Y {¢} = {%0, ¥1s +++ > Yat is a partition of [a, 
b] and y,=c for some j, 1 <j <m— 1. Now {yy y,,.--,y} and ty, ...,¥,,$ are partitions of [a, c] 
and [c, b], respectively, and we have 


x lex) — ata) s lat.) — aa +S ford — ays) 


isyel 


< Vin + Veo 
It follows that 


Via < Vin + Veo 
| 


and therefore, . 
As an application of Theorkéa $4 Wjawe Kfmpute the total variation of a(x) = |x| on [-3, 1]. Since a 


is increasing on 10, 1], Vox = a(1) — «(0) = 1, Similarly, Y°3« = 3. Thus 
Vise = Vo 30 + V ba = 4 


Theorem 54.8 Let %€ 4V[a, 4] and define B*) = V2« ifx € (a, b) and let f(a) = 0. Then f and y = B — 
a are increasing functions on [a, b] anda =f — y. 


Proof. Suppose x, ye [a, b|] withx < y. By Theorem 54.7, 
B(y) — B(x) = View -— Views 


and therefore f is increasing on [a, b]. For the partition {x, y} of [x, y] we have “(¥) — «() = Vie, and 
thus 


WY) — yO) = Va — [a(y) — a(x)] = 0 
and therefore y is increasing on [a, b]. m 


Corollary 54.5 and Theorem 54.8 combine to give an elegant characterization of functions of 
bounded variation. 


Theorem 54.9 Let a be a function on [a, b]. Then # € 4a, 4] if and only if a@ is the difference of two 
increasing functions. 


Proof. The proof follows immediately from Corollary 54.5 and Theorem 54.8. 


Exercises 


54.1. Show that the following functions are of bounded variation on the given interval and find the 
total variation. 
(a) a(x) =x? [-2, 1] 
(b) GG) =x Px" =x 1 [-2,2] 

54.2 Find a formula for the total variation function (+) = Vie for the functions of Exercise 54.1. 

54.3 Prove the second equation of Theorem 54.4. 

54.4 Prove that if¢ € 3V[e¢, 4], then |«] € 3VIe, 4], 

54.5 Prove that if% = 4V[¢, 4) and for some positive number M we have |a(x)| > M for x in [a, 5], 
then I/« ¢ BY [a, 4]., 

54.6 Let «, Se BVIa, 6), Prove that max {a, /}, min {« 8} © BV[a, 4), 

54.7 Give an example of a function a which is continuous on [a, b] and differentiable on (a, 5) 
such that % € 8V(a, 6}, but a’ is unbounded on (a, b). 

54.8 (a) Let%€ 4V[¢, 5] and let &(s) = Vie. Prove that a is continuous at a point c in [a, b] if and only 
if 6 is continuous at c. 
(b) Let a be a continuous function on [a, b]. Prove that * © 4V[a, 4] if and only if a is the 
difference of two increasing continuous functions. 
54.9 Let%e V[a, 5} and let £(%) = Viz. Prove or disprove: Ifa is differentiable at a point c in (a, 


b), then f is differentiable at c. 
54.10° Let%© 5V[¢, 5), Prove that the set of discontinuities of a is countable. 
54.11 Ifa isa function on [a, 5], a is said to satisfy a uniform Lipschitz condition of order p > 0 
on [a, b| if there exists a number M > 0 such that ja(x) — a(y)| < M|x — yP for x, y  [a, 5]. 
(a) Let a be a function which satisfies a uniform Lipschitz condition of order p on [a, 5]. 
Prove that ifp > 1, a is constant. Prove that if p = 1, then # © 4V/[a, 4], 
(b) Give an example of a function a which satisfies a uniform Lipschitz condition of order p < 
1 on[a, b], but « ¢ BV[a, 4}, 
(c) Give an example of a function % € 4V[4, 6] which satisfies no uniform Lipschitz condition on 
[a, b]. 
(d) Prove that if% © 4V[¢, 4] and if g satisfies a uniform Lipschitz condition of order 1 on 
[¢, d] > af(e, 6), then g ° «€ BV[a, 4]., 
(e) Use (d) above and an argument like that given in the proof of Theorem 51.13 to prove that 
if #, B € BV[a, 5), then a-f, |a|, and 1/8 (if B is bounded away from zero) are also in BV[a, 
b]. 


55. Riemann-Stieltjes Integration with Respect to Functions of Bounded 
Variation 


In this section we extend the results of Section 51 concerning integration with respect to increasing 
functions to integration with respect to functions of bounded variation. Our main tools are Theorem 
54.8 which states that if *¢4Vl¢,4], then a is the difference 8 — y of the increasing functions 


A(x) = Vix and y = 8 — a and Theorem 55.2 which states that if *©4Vl4,5), and fe #,[¢, 4], then 
fe &,[a, 6] 0 #,fa, 5] 


Theorem 55.1 
(i) If fis continuous on [a, b] and * € 4V[¢, 4), then f¢ #,I¢, 4], 
(ii) If f¢ BV[a, >] and a is continuous on [a, b], then f¢ 2.4, 4), 


Proof. Suppose that fis continuous on [a, b] and % € 4V[4, 4], By Theorem 54.8, a = 8 — y, where 
B and y are increasing on [a, b]. By Theorem 51.10, © #sl@, 41% %,[¢, 6] By Corollary 53.4, 
fe Ry_,fa, 0), 


Part (11) follows from (i) and Theorem 53.3 (integration by parts). my 


Let * € 5V[a, 5] and suppose f¢€ #.[¢, 4], By Theorem 54.9, a = f* — y", where f” and y" are increasing 
on [a, b]. Now f may or may not be integrable with respect to f° or y’. However, the next theorem 
shows that if we take 6” = 8, where A(x) = Vie and y = y =f — a, then fis integrable with respect to 
f and y. 


Theorem 55.2 —_ Let © 4V[4,4] and suppose f¢ 4.14, 4], Let A(x)= Vie and let y = 6B — a. Then 
fe &,[a, 6] 0 &,fa, 6] 


Proof. If B(b) = 0, then f is constant, and thus f¢ #,[¢, 4], Thus suppose f(b) > 0. Suppose |f(x)| < 
M for all x in [a, b]. 


Let g > 0. There exists a partition P, of [a, b] such that if P* > P,, we have 


é 
Pa 


scr P*, T*) — [ f dal <5 


There exists a partition P, = {¥o, ¥,,--->¥,} Of La, b] such that 
Bb) — po = Vin Do YS lal) — of 7,- dh 
4M rere 4M J yi Vi-) 


Let? = Pi YU P2 = {Xo X41, -+-5 Xx}. Then 


isu 7) es [fa <5 
Bib) — Y ex) = of: < ay (55.1) 


YO, — m){(BGe) — Bor = laG) ~ a€,-D0 


Now s 2M ¥ {p6ex) — pli) - Ste) ~ oto 
; 7 (55.2) 
= 2 (6) ~ $ taox) — afew) < 2M gee = § 
ne A= {ill sis nand a(x) — a(x;-,) > 0} 
_ Bu: {i,...,0y\A 
Let 6 = ¢/(4B(b)). If i ¢ A, choose te» # €[X;-1, *] such that 
f(t) — fG7) > M;- m, - 6 
Ifi ¢ B, choose ts &* €L%;-1, *] such that At) — ft) > M;-_m;- 46, Then 
¥ Ot, = mole) ~ a6, 
s py L(t) — Ala.) — a ;- 1) 
+ FM) = AeMlots) = as) + 8 Y late) — aCe 
= ¥ (Med) — fea) — ale-3)) + 8 Y fate) — aCe) (55.3) 


Let T= {t,,...,¢,} and?* = {¢1, ..., 4}. By inequality (55.1), we have S(f, P, T) — S(f, P, T’) < 4/4. 
Combining this inequality with (55.3), we have 


z, (M, —- m,)|ee(x,) — ax;-1)| < ; +6 by la(x;) — o(x;_ 1) 
g & E 
$47 BOO =2 (55.4) 


Inequalities (55.2) and (55.4) now give 
Uf. P) ~ LLP) = (My — mM) — BOW <8 


By Theorem 51.8, f¢ 4.12, 4]. By Corollary 53.4, /€ #p-alt 5], y 


We are now ready to extend the results of Section 51.. 
Theorem 55.3. Let *€ 3V[a, 4] and suppose /¢ #.[¢, 4], Then J¢ #.[¢, 4] for every closed subinterval 


[c, d] of [a, b] and 


b 


| dem [ fide + | fide 


for all c in (a, b) 
Proof. Let B) = Vie and let y = 8 — a. By Theorem 55.2, fe @gla, 4] 9 4,12, 6], By Theorem 
51.11, £¢ Ale, 4] 9 B,le, 4] for every closed subinterval [c, d] of [a, b] and 


[ap = [rap + [fap 


= [fa ” [fa F [fa 


for all c in (a, b). Now 
[tax = [rae - n= (sap - [4a 

[sae | san ~ ([_ser+ [ra 

A 

\ 


fd(B —) + [ Fae -» 


= | fdx+ [tae 


where we have used Corollary 53.4. my 
Theorem 55.4 Let #€ 4V (a, 5] and let f¢ #.[4, 4]. Suppose that m < f(x) < M for x in [a, b]. If g is 


continuous on [m, M], then 9 °f¢ Ala, 4), 
Proof. The proof follows from Theorems 54.8, 55.2, and 51.12. m 


Theorem55.5 Let %€ 45V[4, 4] and let f, ¢ © 4.14, 4]. Then fg © 4/4, 4]. 


Proof. The proof follows from Theorems 54.8, 55.2, and 51.13(ii1). my 
Theorem 55.6 Let € 3V[a,5] and let BG) = Vie. If fe @,la, 4), then |f]¢ la, 6] 9 pla, 6), and we 


have 
by 
| | f de 


Proof. Let y =a — f. By Theorem 55.2, /€ 4al@, 4] 9 #,[4, 4] and hence by Theorem 51.13(v), 
[fl € Bla, 6} 0 2,[a, 6). By Corollary 53.4, fl ¢ Ala, 4], Let 


b 
< | irl dB 


By Corollary 53.4, l/l © #,l¢, 61% 4,[@, 4], Tt is easy to verify that p and q are increasing on [a, b]. By 
Theorem 51.13(v) and Corollary 53.4, we have 


[fa - [fa 


[sac es a| = 


(ft 
= ||’ Fao] + 744 < [ifid + | ide 
- [ride +a) [ities 


The last theorem of this section shows, that in certain cases, a Riemann-Stieltjes integral may be 
reduced to a Riemann integral. 


Theorem 55.7 Let a be continuous and differentiable on [a, b]. If £«' ls b], then /¢ 2.14, 4] and 
'b ‘b 
| fda = | S(x)a’(x) dx 


(Note since a' is bounded on [a, b], then # € 4V[a, 4],) 


Proof. Let B(x) =x. By Theorem 55.5, f:#’ € Ala, 4], Suppose |f(x)| <M for all x in [a, b]. In this 
proof we let S, denote the Riemann-Stieltjes sum for the integrator y. 
Let g > 0. There exists a partition P of [a, 5] such that if P* > P, then 


S,( fe’, P*, T*) — | fxn (x) ay <5 55.5 
° (32°63 
and fe &,{a, 5] 0 &,[a, 6] 
Let ?* = {0% +++ >%m} > P and let €Pi-1.*d fori=1,...,7. 


Let T= {t,,...,¢,}. We show that 


<= & 


SAF, P*, T) - | forw'en PA 


thus establishing the theorem. 
By the mean-value theorem, there exist 8¢€[:-1,*d such that 4% = %) — @O%-1) = &()O; — x;-1) 
fori=1,...,n. Let 
‘ if «’'(s;) — «'(t) = 0 
vv; = 
‘lt ifa(s) — w(t) <0 
: if «’(s;) — a'(i,) = 0 
i; = 


S; if a’(s;) — a’{t,)) < 0 


fori=1,...,n. Let T= {v,,...,v,} and 7” = {u,,...,u,}. Then 


> la'(s,) — a(t (x; — x11) = os [a'{o;) — a’ (ux, — x,-1) 
= S,(w’, P*, T*) — S,(a', P*, T**) 


<a | . (55.7) 
by inequality (55.6). Now 


» a b 
si, P,7) ~ | few as] =|3 see) aa — [fee al 


= |, Fee NG — x1) 
+ ZA) ~ ea: — x0) — [469209 a 
= |sfe, PY, 7) — [ feow'on a 


+ Y [seal 6) ~ De — 20 


é = s a 3 . 
<5+ Mey loss) — WUC: — Xj.) <5 + MoE =e 


where we have used inequalities (55.5) and (55.7). m 


We may deduce one part of the fundamental theorem of calculus which gives the standard method of 
evaluating Riemann integrals. 


Corollary 55.8 Let fbe continuous and differentiable on [a, b]. If / ¢ Ale, 4], then 
| /'@) dx = 10) - Ka 


Proof. Take a of Theorem 55.7 to be fand take f of Theorem 55.7 to be the constant 1. Then 


fl) - fa) = | 1ar= | fe)as 
We adopt the standard notation 


f@)| = f@) - f@ 


b 
a 


Examples. 


4 


z Zz 2 x 
| 7 ax? =| ox dx = | 9x3 dy = 
0 0 0 2 


2 
=8 


4] 


Let [x] denote the greatest integer less than or equal to x. 


|, [x] dx* = \ [x] 2x dx = i [x]2x dx + i [x]2x dx 
0 0 0 1 
3 


1 2 
ie) 1 


2 
1 


The last integral may also be evaluated using integration by parts. 


\, [x] dx? = [x]x? ’ 
0 0 


- | diy - 8-1 +4)=3 
Q 


The integral Jo x* 4[] was evaluated using the method of Example 51.9. 


Exercises 
55.1 Let% © 8V{a, 4], Give an example of increasing functions f” and y" and a functionf€ 2.14, 4] 
such that a = #* — y* and f€¢ #p-La, 4), 
55.2 Give the details of the proofs of Theorems 55.4 and 55.5. 
55.3 Evaluate the following integrals: 


(a) ‘ vx dx? 


(cy J, bb ae 
55.4 Let {a,} be a sequence. For x = 1, let 


Cx] 
ac) = Fa 
Suppose that fis continuous and differentiable in [1, a]. Prove that 


Eafe) = —]) AS) de + AMS) 


55.5 (Second mean-value theorem.) Suppose that a is continuous on [a, b] and that fis increasing 
on [a, b]. Prove that there exists a point c in [a, b] such that 


b c b 
[fede = flay |" da + £06) |” de 
55.6 Let%€ 4V(a, 5] and let fbe continuous on [a, b]. Prove that 
b 
adi. SU, P, r) a [fe 


55.7 Let #€ 8V{a, 5] and let fbe a bounded function on [a, b]. Prove that if lim,,,., p49 SG P, 7) 
exists, then /€ #,[@, 4] and 


bd 
wit, Sf, £ F) = [fe 
55.8 Let*©8V[a, 5] and suppose that a is continuous on [a, b]. Prove that if f¢ #.[@, 4], then 
b 
eect, Sf f, r) zm [fe 
55.9 Let%¢ 8V[a, 4), Prove that if f¢ #14 4], then max {f, g} and min {f, g} are in Ra, 5]. 
55.10 Let *©4V[a, 5], Suppose thatf€ #.[¢, 4] and there exists a positive number M such that |f(x)| > 
M for x in [a, 6]. Prove that life #.la, 4}. 
56. The Riemann Integral 


In this section we prove the fundamental theorem of integral calculus and a change of variable 
formula for the Riemann integral. 


Theorem 56.1 (Fundamental Theorem of Integral Calculus) 
(i) Let f be continuous and differentiable on [a, b] and suppose /’ ¢ Al, 4], Then 


[ fi) dx = fle) - fla) 
(ii) Let f¢ Bala, 8). Let 
F(x) = [; f(t) at 


for x in (a, b] and let F(a) = 0. Then F is continuous on [a, b] and F'1s differentiable at every point 
at which fis continuous. If x is such a point, we have F"(x) = f(x). 


Proof. Part (1) restates Corollary 55.8. 
Suppose |f(x)| < M for all x in [a, b]. Let g > 0. Let 6 =2/M. If |x — y| < 6 withx < y, we have 


FQ) — FO) = | fit) at 


< | ides | Mar=My-29<s 


and therefore F' is continuous on [a, 5]. 

Suppose f is continuous at a point x in [a, b]. Let g > 0. There exists 6 > 0 such that if |v — x| < 6, 
then |f(v) — f(x)| < ¢. Suppose 0 < |y — x| < 6. Without loss of generality, we assume y > x. (The case 
for y < x is similar.) By Theorem 51.13(iv), since f(x) — ¢ < f(z) < f(x) + ¢ for all z between x and y, 
we have 


Lf) — ly - 2) < Fy) - FQ) = [70 dt < Lf(x) + Ky — ») 


_, - FY) — FQ) 
Therefore, lal Pe 


which implies that 


< fix) +e 


Se 


F(y) — FQ) 
ea — f(x) 


and thus F’(x) = f(x). m 


Corollary 56.2 Let f be a continuous function on [a, 5]. 

(1) There exists a function F’ such that F' is continuous on [a, 5], differentiable on [a, b], and F’(x) = 
f(x) for all x in [a, 5]. 

(11) If G is continuous on [a, b], differentiable on [a, b], and G'(x) = f(x) for all x in [a, 5], then 


[ ff) ad = Gb) -— G(@) 


Proof. Part (1) follows from Theorem 56.1(1). 
Let G be as in part (11). By Theorem 56.1(1), 


| fo) dx = [ G'(x) dx = G(b) — Ga) 
a a gz 


In our subsequent work we will need the following change of variable formula. Another change of 
variable formula where g is not assumed to be increasing is given in Exercise 56.3. 
Theorem 56.3 Let f¢ #,[4,4] and let g be a strictly increasing function from [c, d] onto [a, b] such 
that g is differentiable on [c, d] and 9’ € Ale. 4]. Then (f° 9)-g' € Alc, 4] and 


b ‘d 
| 769 _ r flalt)g'(a) at 


Proof. Suppose |f{(x)|< M for x in [a, b]. Let g > 0. There exists a partition P, of [a, b] such that if 
P¥ > Py, we have 


sun Pt. 7) - [sey as| <3 


There exists a partition P, of [c, d] such that if ? 2 > Py, we have 


a (56.1) 


se PS, T3) = [eo dx 


Since g is a strictly increasing function from [c, d] onto [a, b], it follows that P,; = g'(P,) is a 
partition of [c, d]. Let? = P24 Ps. Let P” = {, y,,...,y,} be a partition of [c, d] containing P. Let 
8 € [1-1 Yd fori=1,...,nand let J = {s,,s,,...,.s,}. We show that 


S(fog)-g', P*, TS) — \. SO) a Be 


which will prove the theorem. 
Let x,= g(y,) fori =0,...,nandt,=g(s,) fori=1,...,n. Then 


PT = 9(P*). = {x9 X55 1 oe HJ 
is a partition of [a, b] which contains P, and &€[i-1.% fori=1,..., 7. Therefore, 
b 
lsca Pts Ta - [709 asl <5 (56.2) 
Where Ths Fo axing hy 


By the mean-value theorem x, — x,_, = g(v) — g(_,) =2'(u)O;, — ¥-,) where % © Oi-1-¥) fori=1,.. 
.,n. Now 


b 
S(fe g)-g', P*, T*) — | fs) dx 


K b 
= ¥ fatsda'e) Av: - | SQ) dx 


= J, Mateda'@) An — ¥ fed Ax + YA) Ax, — [fs ax (56.3) 
= ¥ Aatsda's) dy. — ¥ Kotedo'wd dy + SLPS TD) 


6 
— {pe ax 
n b 
= 3 AosMa'Gsd — oud) Avs + SCL PE TH) ~ | 90) as 


We have 


Y Aatsola'ed — aud) dy, 


< ¥ [fotsalla's) — a' ol Ay; 
< MY la) — o'wal dy, 
28 
<M(ze) =F (56.4) 


where we have used inequality (56.1) and an argument like that given in the proof of Theorem 55.7. 
Inequalities (56.2), (56.3), and (56.4) combine to give 


ee] 
S((feg)-g', P*, T*) — | f(x) dx 


<6 
For example, if f¢ #.[¢, 4] and i let o(t) =t + k, we'liave 


i fx) dx = \. fit + adi 
a a-k 


Exercises 
56.1 Let / be an interval of R and let fbe a function on J. We say that fis absolutely continuous on 
Tif for every g > 0, there exists 6 > 0 such that if {(@:, 40}f-1 is a finite set of open subintervals 
of J with (4, 4) 9 (@, 5) for i #7 and Lk=1 (k — a) < 6, then Lies |G) —f@d| < @, 
(a) Prove that if a is absolutely continuous on [a, b], then a is continuous and of bounded 
variation on [a, b]. 
(b) Prove that if a is absolutely continuous on [a, b], then a = 6 — y, where f and y are 
increasing and absolutely continuous on [a, 5]. 
56.2 Let*©8V[a, 5) and suppose that /€ #14; 4), Let 


P(x) ={" fide 


for x in (a, b] and let F(a) = 0. 

(a) Prove that f¢ 8V[a, 5], 

(b) Prove that if a is continuous at x, then Fis continuous at x. 

(c) Prove that if a is absolutely continuous on [a, b], then F' 1s absolutely continuous on [a, 5]. 
(See Exercise 56.1 for the definition of absolutely continuous.) 

(d) Prove that if a is increasing on [a, b], then F'1s differentiable at each point at which a is 
differentiable and fis continuous; and that if x is such a point, we have F’(x) = f(x)a'(x). 

56.3. Let g’ be continuous on [c, d] and let fbe continuous on g([c, d]). Let a = g(c), b = g(d). 
Prove that 


[700 dx = [Poa at 


56.4 Let g be continuous on [a, b| and suppose that fis increasing on [a, b]. 


> c b 
(a) Prove that J_Senate) as = f(a): I, oka) he 1) [ae ax for some c in [a, b]. 


(b) (Bonnet's Theorem) Prove that if in addition to the hypotheses in part (a), fis nonnegative, 
then 


[Feng dx = f@: f° oa) dx + £O> [" o(e) ae 


for some c in [a, 5]. 
56.5 (a) Prove the trapezoid rule: If” exists on[c — h, c + h], then 


[ FGdg(2) dx = $0) |? 9() ax 


wherec-h<é€<cth. 


(b) Subdivide the interval [0, 1] into 10 equal parts and use the trapezoid rule on each 
subdivision to estimate Ja 4/1 + x*), Estimate the error. (We shall see later that 


§ dx}(1 + x*) = 2/4.) , 
56.6 (a) Prove Simpson's rule: If f exists on [c — h, c + h], then 
[f= are +) +4e—m - 22" 
(b) Repeat Exercise 56.5(b) replacing the trapezoid rule with Simpson's rule. 


56.7 (a) Derive the rectangle rule, which approximates Jétif@) dx by 2hf(c), together with a 


remainder estimate similar to the trapezoid rule and Simpson's rule [see Exercises 56.5(a) 
and 56.6(a)]. 


(b) Repeat Exercise 56.5(b) replacing the trapezoid rule with the rectangle rule. 
56.8 Prove that the following form of the integration by parts formula 1s valid for Riemann 
integrals: If /’, ¢’ € ale, 41, then 
[f= Sire + + 4/0 +4 — my) -@* 


56.9 Suppose that fis (n + 1)-times differentiable on [c, d] and f“*” € fe, 4], Derive Taylor's 
theorem (Theorem 50.3) with integral remainder by beginning with the formula 


[.f'9 =f@9® — f@g(a) — |" fa’ 
and proceeding by using integration by parts. The next step would be 
[ir -ro — ol + [red - nar 
56.10° Suppose f’€ 40, 1]. Prove that 
vals | +e ir 


57. Measure Zero 


The next two sections of this chapter are devoted to deriving a necessary and sufficient condition for 
the existence of the Riemann integral. We will prove (Theorem 58.5) thatf¢ #,[¢, 4] if and only if f is 
continuous “almost everywhere” in [a, b]. To define almost everywhere, we must begin with the 
concept of measure zero. 


Definition 57.1 Let X be a subset of R. We say that X is of measure zero if for every g > 0, there 


“@ 


exists a countable family {J,} of open intervals such that Usei 4: > ¥ and Dye, || <&, where [J 
denotes the length of the interval J. 


In other words, a subset X of R is of measure zero if X can be covered by a countable family of 
open intervals the sum of whose lengths can be made arbitrarily small. 


Examples. A finite set X= {x,,...,x,} 1s of measure zero. For if > 0, the family 


covers X and 


and therefore X is of measure zero. 
The set Q of rational numbers is of measure zero. Indeed any countable set is of measure zero. For 
suppose 


i= {X15 Xa, ae } 


is a countable set. For each positive integer n, choose an open interval J, containing x,, such that |/,| < 
2/3". Then 


U 
n=1 


and 


a @ 1 
ylsey woz <e 


holm 


Therefore, X 1s of measure zero. 
The method of the last example may be used to prove that a countable union of sets of measure zero 
is of measure zero. 


Theorem 57.2 If {X,} is a countable family of sets of measure zero, then Un=1 % is of measure 
zero. 


Proof. Let ¢ > 0. For each positive integer n, there exists a countable family !}2: of open 
intervals such that Ue: #1” > %, and Xie, || < ¢/3", The family 


U1? | ine P} 


is countable (Theorem 9.5) and covers Un=1%_ and 
a 
S10] < 3 Roa <s 
Having given several examples of Séts'Of measuré zero, We now give an example of a set which is 
not of measure zero. 


Theorem 57.3 The closed interval [a, b] is not of measure zero. 


Proof. It is easy to show by induction that if Je=1 is a finite set of open intervals which covers 
[a, b], then 


ubMijs 


Mal 2b — a (57.1) 


k 


i 


Suppose [a, b] is of measure zero. Taking g = (b — a)/2, there exists a countable family {J/,} of 
open intervals which covers [a, b] such that 


& b-—a 
Be FA < D) 
By the Heine-Borel theorem (Theorem 34.2), some finite subcollection “}3=1 covers [a, b]. Now 
us i) bh — 
Y hd < > a <—— 
JF kei 


which contradicts (57.1). Therefore [a, b] is not of measure zero. m 


Theorem 57.3 furnishes yet another proof that irrational numbers exist. For if [0, 1] contains only 
rational numbers, by Theorem 57.2, [0, 1] is countable, hence of measure zero. However, this 
contradicts Theorem 57.3. 


Figure 57.1 


A remarkable fact is that uncountable sets of measure zero exist. The standard example is the 
Cantor set (see Figure 57.1). 


Definition 57.4 From the closed interval [0, 1] we remove the open middle third 41 = G4) yielding 
the set 


[9,3] 4 [3 Y 


From each of the closed intervals [0, $] and [4,1] we remove the open middle thirds (6) and @, ¢ 
yielding the set 


(0, U6, 4) 4 a) UE, 
We let /2 = G5) Y G, 5). At the nth stage we have closed intervals 
Fis J25 oh ey Jan 


From each of the closed intervals J, we remove the open middle third / fork =1,..., 2”, yielding 
the set 


VE) VFO) G0 Tan\Z) 


We let 4a = Uk21 7. The Cantor set C is the set 


0 \ Ot 
n=l 
Some properties of the Cantor set are immediately obvious. Since C is the intersection 


[0, 1}n (a i) 


of closed sets, C is closed (Theorem 38.8). Since © | [9 1], C is bounded. By Theorem 43.9, C is 
compact. 


Theorem57.5 The Cantor set is uncountable and of measure zero. 


Proof. We first show that C is of measure zero. At the nth stage (see Definition 57.4), C is 
contained in the union of closed intervals 


J; U ds UU Jan 


where |J,| = 1/3" fork =1,..., 2”. Let g > 0. Choose a positive integer n such that G)" < 2. Cover 
each closed interval J, by an open interval J, such that |J,| < 1/3" + 2/2”"', fork =1,..., 2”. Then 
Ujéi=1 is a finite set of open intervals which covers C and 


a" 2 1 £ We £ 
I ataorm)=(s) +2 
», il < 2, (5 = er) (3) i a <6 


&= 


Therefore C is of measure zero. 


Suppose that Cis countable. Then 
Cc = {a;, @, es J 


Choose the interval [9, 3] or [4, 1] to which a, does not belong. Call this interval [c,, d,]. Remove the 
open middle third from this interval [c,, d,] yielding [41 42] ¥ [43. 44]. Choose the interval [b,, b,] or 
[b;, b,] to which a, does not belong. Call this interval [c,, d,]. Continue in this way. Then the 
sequence {c,} converges and if c = lim, c,, since C is closed, c ¢ C. But now c # a, for every 
positive integer n, and we have the desired contradiction. Therefore, Cis uncountable. m 


The argument given above to show that C is uncountable is similar to the proof of Theorem 9.8 
which shows that R is uncountable. The fact that C is uncountable may also be deduced from 
Corollary 47.8 


Definition 57.6 Let / be an interval in R. A property P is said to hold almost everywhere in I if the 
set of x in/ for which P fails is of measure zero. 


Examples. We will be concerned primarily with functions which are continuous almost 
everywhere. According to Definition 57.6, fis continuous almost everywhere on [a, b] if the set 


{x € [a, 5] | f is not continuous at x} 


is of measure zero. 
Let f(x) = 1 for all x in[a, b] and let 


1 if x is irrational 
g(x) = 


0 if xis rational 
Then f(x) = g(x) almost everywhere in [a, b] since 
{x €[a, b] | f(&%) # g(x} 


is countable and hence of measure zero. Notice that g is continuous at no point of [0, 1] and fis 
continuous at every point of [0, 1]. Therefore, f = g almost everywhere in [0, 1] implies nothing about 
continuity relationships. 


Exercises 
57.1 Let X be a subset of R which is of measure zero. Prove that every subset of X is of measure 
zero. 
57.2 Give the inductive proof that if {£=1 is a finite set of open intervals which covers [a, b], 
then 


F lilzb—e 
k=l 


57.3. Prove that any interval of R is not of measure zero. 

57.4 Prove that the Cantor set is the set of all numbers of the form Ls=: 4/3" where a, is either 0 or 
2. Use this fact to deduce that Cis uncountable. 

57.5 Prove that the Cantor set is uncountable using Corollary 47.8. 

57.6 For this exercise assume the following theorem. 

Theorem If a is increasing on [a, b], then a is differentiable almost everywhere in [a, 5]. 

(a) Rephrase this theorem using the term measure zero. 
(b) Prove that if © 4V[4, 5), then a is differentiable almost everywhere in [a, )]. 

57.7 Let be continuous on [a, b] and suppose that f(x) = 0 almost everywhere in [a, b]. Prove that 
f(x) = 0 for all x in [a, 5]. 

57.8 Prove that ift © 4Vl¢, 4), then a is continuous almost everywhere in [a, b]. 

57.9 Prove or disprove: If fand g are continuous almost everywhere in [a, b], then f+ g is 
continuous almost everywhere in [a, 5]. 


58. A Necessary and Sufficient Condition for the Existence of the Riemann 
Integral 


This section is devoted to proving that /¢ #.[¢, 4] if and only if fis continuous almost everywhere in 
[a, b]. 


Definition 58.1 Let fbe a bounded function on [a, 5]. If / is an interval, we let 
wT) = lub {f(x) | xe Zn [a, 4)} — glb (f() | xe Zn [a, 8]} 
We call (J) the oscillation of f on I. Ifx € [a, b], we let 
a(x) = glb {w,(J)} 


where the greatest lower bound is taken over all open intervals J containing x. We call w({x) the 
oscillation of f at x. (Since w{J) 2 0 for every open interval J, glb {w/(J)} exists.) 

The oscillation function enters into the theory of the integral in the following way. Let f be a 
bounded function on [a, b] and let P= {x,,x,...,x,} bea partition of [a, b]. Let , = [x,_,, x,] for k= 
1,...,”. Then we may write 


U(f, P)— Lf, P) = >» © (Fh (58.1) 
If f¢ 2,la, 4), by Theorem 51.8, the sum in (58.1) must be small. But for the sum in (58.1) to be small 
either w{J,) or |/,| must be small for k = 1, ..., m. The next lemma shows that the size of the 
oscillation is linked to continuity. 


Lemma 58.2 Let fbe a bounded function on [a, b] and let x € [a, b]. Then fis continuous at x if and 
only if w(x) = 0. 


Proof. Suppose that fis continuous at x. Let g > 0. There exists 6 > 0 such that if |y — x| < 6, then 
i) — f)| < e. Thus if YE 4 = @& — 9x + 8), then fix) — e < fly) < Ax) + e. Therefore, wf{J) < 2¢ 
(verify). It follows that 0 < w(x) < 2¢ for every ¢ > 0, and hence w{x) = 0. 

Now suppose w{x) = 0. Let > 0. There exists an open interval J containing x such that w{J) < ¢. 


There exists 5 > 0 such that &* — 6, x + 6) < J. Now if |y — x| <0, then y ¢ J, and hence - 


= J 
Lemma 58.3 Let f be a bounded fener on i BI Wed let > 0. Then {¥ € [a 4] 1 a) < 8} is open 
(in [a, 5]). 


Proof. Let 
X = {xe [a, 5] | w(x) < s} 


Let x eX. We must show that there exists 6 > 0 such that & — 6, x + 8) [4,5] < X, Since ox) < s, 
there exists an open interval J containing x such that w{J) < g. Since 4 [4 4] is open, there exists 6 > 
0 such that @ — 6% + 6) 9 [a, 6] < Jn [a, 6], Let ye @ — 6, x + 6) 9 [2,8]. Theny € J; so wy) < af) < 
e. Therefore y e¢ X and X is open. m 


Lemma 58.4 Let f' be a bounded function on a closed interval J. If w(x) < ¢ for every x in J, there 
exists a partition P of J such that 


U(f, P)— Lf, P) < alJ| 


Proof. For each x in J, there exists an open interval /, containing x such that w(I,) < e. By the 


Heine-Borel theorem, the collection {/,} has a finite subcover {/,,...,/,}. Let P= {x ), x,,...,x,} 
be the set of end points of the intervals {41 04; --- +494}. Then @{[x,,,x,]) <e fori=1,...,n, and 
we have 


UF P) — Lf. P) = ¥ ogllsi- xe 1-1) < al 


We are now ready to prove the main theorem of this section. 


Theorem 58.5 (Lebesgue) Let f be a bounded function on [a, b]. Then f¢ #.[¢, 4] if and only if f is 
continuous almost everywhere in [a, 5]. 


Proof. Suppose that f¢ 2/4; 4], Let X be the set of points in [a, b] at which fis not continuous and 
let 


Xn = {rela b] | ox) = rt 


for m= 1, 2,.... By Lemma 58.2, ¥ = Un-=1 Xm, By Theorem 57.2 it suffices to prove that _Y, is of 
measure zero for every positive integer m. 
Let m be a positive integer. Let , > 0. By Theorem 51.8, there exists a partition P= {x,,x,,...,x,} 


aa 7) 


of [a, b] such that 


z & 
2%, edit < a, (58.2) 
where J, = [x,_,,x,] fori=1,..., 7. 
Let ¥n = Xn P and let let Xn* = Xy\XR. If xe Xn", then x€(i-1, x) for some positive integer i and 
o([x;X)]) = ox) = 1/m. Let fo ++ +> te denote those intervals [x, ,, x,] which contain a point of Xn" 
. Then 


US, P) = K(f P) = ¥ (UU, P) ~ LG, PI) + ¥ coll Ma, 0 U0 


1 2 k 
<a 2, Mil + eglla, BD Y Vad 


mj; 
< o— a ({a, 5] = Se Eos 
m + ile, Doria op <2t2=8 
Therefore, k E 
ps til <5 
Now Xn" is covered by the interiors of /i:- ++» 4% the sum of whose lengths is less than ¢/2. Since Xm 


is a finite set we may cover Xm by a finite number of open intervals the sum of whose lengths is less 
than g/2. Therefore %» = Xm V Xn" is covered by open intervals the sum of whose lengths is less than ¢ 
, and hence X,, is of measure zero. 

Now suppose that fis continuous almost everywhere in [a, b]. If w{[a, b]) = 0, then fis constant 
and hence f€ #,[@, 4); so we assume that w/([a, b]) > 0. Let g > 0. Choose a positive integer m such that 
(b — a)/m <,/2. 

If X,, is defined as above, then X,, is of measure zero. Thus there exists a countable set {/|} of open 
intervals such that %m | Us1 4 and 


E 


Dl < Forte bp 


By Lemma 58.3 and Theorem 39.5, X,, is closed in [a, 6] and thus is compact. Hence there is a finite 


subcollection Un: --- > 45 of {1} which covers _X,. Now 
Kk 
2 B\( U 4) 
is a union of closed intervals J,,...,J,. If *€ J;, then wx) < 1/m; so by Lemma 58.4, there exists a 


partition P, of J; such that 


UU, P) — LP) < 


fori=1,...,p. Let? = Usa Py Uta} U{b}. Now 


Uf P) — K(f, P) = ¥ (UU, P) ~ LG, PI} + ¥ cola Ma, 0 (a 


rc & 
<a 2, Md + ola, BD YY Vad 


a + o,([a, b) => te bp 


& 3] 


é é 
By Theorem 51.8, f #,| ] | 


Corollary 58.6 If f¢ #.[@, 4] and J || = 0, then f(x) = 0 almost everywhere on [a, b]. 


Proof. We show that f(x) = 0 for each x in [a, b] at which fis continuous. By Theorem 58.5, this 
implies that f(x) = 0 almost everywhere on [a, b]. 

Suppose f(x) # 0 for some x in [a, b] at which f is continuous. Then |f/(x)| > 0 so there exists a 
closed interval [c, d] containing x such that |f(y)| > \f(x)|/2 for all y in [c, d]. Now 


yeJ=(x —6,x+ 6). 
and we have a contradiction. Therefore, f(x) = 0 almost everywhere in [a, Db]. m 


Corollary 58.7 Let f¢ #.[4, 4] and let 
F(x) = | f 


for x in (a, b] and let F(a) = 0. Then F 1s differentiable almost everywhere in [a, b] and F(x) = f(x) 
almost everywhere in [a, 5]. 


Proof. By Theorem 56.1(11), F’(x) = f(x) for each x in[a, b] at which fis continuous. By Theorem 
58.5, fis continuous almost everywhere in [a, b] and the conclusion now follows. m 


Exercises 

58.1 Let f¢ 2.[¢, 4] and suppose that Ji/= 9 for all x in (a, b]. Prove that f(x) = 0 almost 
everywhere in [a, 5]. 

58.2" Let £9 © l4,4] and suppose that f(x) = g(x) almost everywhere in [a, b]. Prove that Jef= Jeg, 

58.3. Using Theorem 58.5 prove that if f¢ 8V |, 4], then f¢ 4.14, 4], 

58.4 State and prove an analogue of Theorem 58.5 valid for Riemann-Stieltjes integrals. 

58.5 Using Theorem 58.5 prove that if 4 ¢ © 4l¢, 4] is continuous on the range of f, and c « R, then f 
+ g, cf, fg, and he fe #[2,4], Prove that if in addition 1/fis bounded on [a, b], then life &.le, 5). 


59. Improper Riemann-Stieltjes Integrals 


So far in this chapter, all of our functions have been bounded and all of our integrals have been 


computed over closed, bounded intervals. In this section we relax these restrictions by defining 
improper Riemann-Stieltjes integrals. 


Definition 59.1 Let f and a be functions defined on the interval [a, 00). Suppose that f¢ #.[¢, 4] for 
every b > a. The improper Riemann-Stieltjes integral (of the first kind) Sz f 4 is the ordered pair (f, 
F), where 


F(b) = | f do. 


for b > a. 
Ina similar way, we define the improper integral J~ 0/4. 


This definition is analogous to the definition (Definition 22.1) of an infinite series. The infinite 
series 


a 
] 
~ 


was defined to be the ordered pair ({a,}, {s,}), wheres, =a,+°-*:+a,n=1,2,....The function 
f of Definition 59.1 corresponds to the function a of Definition 22.1 and the function F' of Definition 
59.1 corresponds to the function s of Definition 22.1. The function F' is sometimes called the partial 
integral in analogy with the partial sum of an infinite series. Convergence of an improper integral is 
defined in terms of convergence of the partial integral F(b) = f° Sf da: 


Definition 59.2 Let [ fda be an improper integral. If limy 0 fe Sf de exists we say that the 
improper integral fo f da converges, and we write 


[fs = lim [fae 


a boo Ja 


If limy 0 ifs Sf de does not exist, we say that the improper integral [™ f da diverges. 
Convergence and divergence of the improper integral [@ x J dx 1s defined ina similar way. 
If the improper integrals [@ xo J da and [© f dy are both convergent, we define 


{" fade = [ fdu + (. fide 
Examples. The improper integral [2 2 converges to | since 
1 x x 2 


oan [ee : 
im | —3 dx = lim (1-2) =1 
ama Jie aww a 


The improper integral f ae / rx diverges since 


F 1 . - 
ia | Jett ~ mae — =e 
Let f(x) =x. Then jz f and j2.,, f diverge (for every a), and hence the improper integral jx, ¢ diverges. 
However, lim, [,f = 0.. We call [4% - Bi da (if this limit exists) the Cauchy principal value of the 
improper integral [@ x f da. We have just seen that the Cauchy principal value may exist for a 
divergent integral. It is easy to show that if the improper integral [@ = f da converges, then the 
Cauchy principal value is equal to the number | fda = ft os 3 da + §@ f dx. 

Many of the theorems for infinite series have analogues for improper integrals. The methods of 
proof are also often similar. For example, if the improper integrals [° {dq and [® g da are 


aco 


convergent, then the improper integral j» (¢ + g) dx 1s convergent and 


[+ aya = |" fda + |" oe (59.1) 


This follows from Theorem 53.2 (for ordinary Riemann-Stieltjes integrals) by taking limits. 
Corresponding to an absolutely convergent series, we have the concept of an absolutely convergent 
improper integral. 


Definition 59.3 We say that the improper integral Jo f da converges absolutely if f= | f | da 
converges and f¢#,[4,4] for all b > a. We say that the improper integral fo fda converges 
conditionally if [ | f| do diverges, but [° f da converges. 


The next theorem parallels Theorem 24.1 for infinite series. 


Theorem 59.4 Let a be an increasing function on [a, ©) and let f be a nonnegative function on [a, 
00). Then the improper integral f° f da converges if and only if the function F(b) = f° Ff da. is 
bounded on [a, «). 


Proof. Suppose Fis bounded on [a, 0). Let 
L = lub {F(})| 6 € [a, o)}. 
Let g > 0. There exists a number 5 such that L — ¢ < F(b). Ifx = 5b, then 


L-e<FO@)< FO)sl<Lh+se 


and thus [°° f da=L. 
Now suppose that [° f dg converges. Ifh € [a, op), we have 


| fade < |: fds 


and therefore F'is bounded on [a, ©). my 


Theorem 59.5 (Comparison Test) Let a be an increasing function on [a, ©). Suppose that fand g 
are functions such that 0 < f(x) < g(x) for x in [a, 0). If f° g dy converges and fe &,{a, 6) for all b > 


a, then [ f do converges and 
[- se < [- g de 


Proof. The proof follows from Theorem 59.4 and the inequality 
a 


b b «© 
fda < | gdu< g de 
We can now show that an absolutely convergent impfoper integral is convergent (for increasing 
integrators). 


Theorem 59.6 Let a be an increasing function on [a, «). If the improper integral Jo f da 
converges absolutely, then f° f da converges. 


Proof. Ifx =a, then 0 < |Kx)| — f(x) < 2\(x)|. By Theorem 59.5, §° (f| — f) converges. By 
equation (59.1), f° f da converges. m 
We now give an example of a conditionally convergent improper integral. Let 
0 ifm is an odd positive integer 


a(n) = 1 ifn = 2m is an even positive integer and m is odd 


—l ifm = 2m is an even positive integer and m is even. 


Extend a linearly to [1, 0). (See Figure 59.1). Let B(x) = JF a(t) for x= 1. Then 0 < f(x) < 1 for x 
> 1. Using integration by parts, we have 


* a(x) Bb) [” BEd 
| a= et | SP ax 


Since £ is bounded on [1, 2), lim, ,,. (B(b)/b) = 0. Since 0 < (B(x)/x’) < I/x’ for x in [1, 0) and 
iy (B(x) x?) dx is convergent, by Theorem 59.5, sf» (f(x)/x?) iS convergent. Therefore, 
fP (a(x)/x) dx 1s convergent. 

Since (1/x) > 1/(2k — 1) ifx < 2k — 1 and i la(x)| dx = 1, we have 


2k-3 
2n—-1 
\ 


for every positive integer n. The series }°"_, 1/(2k — 1) diverges, and therefore the sequence of 
partial sums ae 1/Qk — ])}1s unbounded (Theorem 24.1). 


1 


a(x) ui 
— dx > a ye | 


n 2k-1 
= ax= } | 


k=2 J2k-3 


a(x) 


x 


Figure 59.1 


Therefore, the function F(@) = J% \a(x)/x| dx is unbounded. By Theorem 59.4, [? |o(x)/x| dx diverges. 
Thus the improper integral {rv (cx( x) [X) is conditionally convergent. 


Our next theorem demonstrates a link between infinite series and improper integrals. See Exercise 
59.10 for another result. 


Theorem 59.7 (Integral Test) Let f be a nonnegative decreasing function on [1, ©). Then the 
infinite series iP nit x) dx converges if and only if the improper integral iP ait x) dx converges. 


Proof. Since fik +1) < f(x) < f(A) fork <x <k+ 1, we have 


kt1 


fk+D< | fO) dx < f() 


Therefore, sO +4 n 
Eke ns |" fs YW 

k=1 i k=1 

The proof now follows from Theorems 24.1 and 59.4. ™ 


We close this section by defining the improper integral of the second kind and giving two 
examples. Analogues of the theorems about improper integrals of the first kind are valid for improper 
integrals of the second kind (see Exercise 59.4). 


Definition 59.8 Let f and a@ be functions defined on the half-open interval [a, b). Suppose that 
fe &,la, c] for a <c <b. The improper Riemann-Stieltjes integral (of the second kind) 


[ fda 
is the ordered pair (f, F’), where 
F() = { fda 


for a<c <b. Ina similar way we define the improper Riemann-Stieltjes integral 


[fa 


« 


It lim F(c) = lim | fda 
c7b7 


ewb" Ja 


exists, we say that the improper integral ( ~ f dy converges, and we write 


bo 
| fda = lim Fic) 
a cmb— 


If lim,_,- Fe) does not exist, we say that the improper integral fe ~ f dy diverges. Ina similar way, we 
define convergence and divergence of the improper integral t. f da- 


Examples. The improper integral [Fs " ( ] / af) dx converges to 2, since 


1 
; 1 : a 
lim | ee lim 2 —2,/e = 2 


e70+ cot 


The improper integral [re + (1/x?) dx diverges, since 


. ] 
lim s=dx = lim --—-l=o0 
e+0* Je cor € 


Exercises 
59.1. Prove that the improper integral SP (/x?)dx diverges if p < | and converges if p > 1. 


59.2 Determine the values of p and q for which the following improper integrals converge 


iL. xen 2 


i 
PD, eee 
i i txq™ exe x?) dx 


59.3 Prove equation (59.1). 

59.4 State and prove analogues of Theorems 59.4, 59.5, and 59.6 for improper integrals of the 
second kind. 

59.5 Prove that if f¢ #,[@, 4], we have 


Fs 


[For this reason, if a(x) =x, we usually write 


a al 
if either improper integral converges. | 
59.6 Give an example of a function f such that the improper integral F ait x) dx converges, but 
lim,_,,, (x) does not exist. 
59.7 State and prove an integration-by-parts formula valid for improper integrals. 


59.8 Prove an analogue of Theorem 26.4 valid for improper integrals. 
59.9 State and prove analogues of Corollaries 28.4 and 28.7 valid for improper integrals. 
59.10 Let fbe a decreasing nonnegative function on [1, «). 

(a) Prove that if the series }" , f(m) converges to L, then 


[5 fo) — U1 < |" sad ae 
(b) Prove that if the improper integral iP ait x) dx converges to L, then 
[sar -—< Ese 
1 n=[x] 


where [x] denotes the greatest integer less than or equal to x. 
59.11 Prove that if the improper integral j=, raz converges, then the Cauchy principal value of 
j..fdx exists and equals je, fds. 
59.12 (a) Given an example of functions f and a such that ¢2 ¢¢, converges absolutely, but j=, ras 
diverges. 
(b) Suppose # € Va, 6] for every b > a. Let BO) = V2 for x > a. Prove that if the integrals 
Sr faa and Je £48 converge absolutely, then Jo f4« converges. 
59.13 (a) Prove that the integral fe **~*e~‘dt converges for positive x. The function F@) = Jé #*~*e“"de, 
is called the gamma function. 
(b) Prove that (x + 1) =xI'(x) for positive x. Deduce that [(n + 1) =n! forn=1,2,3,.... 


X 


Sequences and Series of Functions 


In this chapter we shall investigate convergence of sequences and series of functions. The results of 
this chapter will extend the results of Chapters IV and V. In particular, we shall be concerned with the 
following problem. If each element of a sequence {f,} of functions has a particular property, when 
does the limit function f have the same property? For example, we might ask whether the limit 
function f is continuous if each function f, is continuous. We begin by defining convergence of a 
sequence of functions. 


60. Pointwise Convergence and Uniform Convergence 


We shall be concerned with sequences of real-valued functions defined on some set X. We shall 
denote a sequence as {f,}@., (or sometimes just {f,}). Thus for each positive integer n we have a real- 
valued function f, defined on a set_XY. The set X will not, in general, be a subset of the real numbers. 


Definition 60.1 Let {f,} be a sequence of functions on a set_X. Let f be a function on X. We say that 
{f,} converges pointwise to f on X if lim,_, f(x) =/f(x) for every x in X. 


Example 60.2 Let 
fO=x O<x<l 
Then {f,} converges pointwise to fon [0, 1], where 


0 Osx< 1 
ff) = 
1 x=1 
.each function f, 1s continuous on [0, 1] but that the pointwise limit function f is not continuous on 
[0, 1]. Thus continuity is not in general preserved under taking pointwise limits. Thus if we wish to 
preserve continuity we must seek a stronger definition of convergence of a sequence of functions. One 
of the most useful notions is that of uniform convergence. (See Theorems 60.4 and 61.1.) 


Definition 60.3 Let {f,} be a sequence of functions on a set_X. Let f be a function on X. We say that 
{f,} converges uniformly to f on X if for every ¢ > 0, there exists a positive integer N such that ifn > 
N, then 


ful) — f)| < € 
for every x in.X. 


The crucial part of Definition 60.3 is that f(x) — f(x)| < « for every x in X (ifn = N). That is, N 
depends on g, but not on x. 

It is clear that 1f a sequence of functions converges uniformly it also converges pointwise (verify). 

We now prove that continuity is preserved under uniform convergence. 


Theorem 60.4 Let {f,} be a sequence of functions which converges uniformly to a function f on a 
metric space M. If each f, is continuous at a point a in M, then fis continuous at a. 


Proof. Let d be the metric for M. Let g > 0. There exists a positive integer N such that 
fn) — SO) <5 
for every xg M. There exists 6 > 0 such that if d(x, a) < 0, then 
fa) — full <5 


Now if d(x, a) < 0, then 


lf) — F@I| = IF) — fxQ)l + LO) — Ax@1 + l7v@ — FOI 
é é & a 
< 3 + 3 + ir E 
Corollary 60.5 If {f,} 1s a sequence of continuous functions which converges uniformly to a function f 
ona metric space M, then fis continuous. 


It follows from Corollary 60.5 that the sequence {f,} of Example 60.2 does not converge uniformly 
to f- Thus a sequence may converge pointwise, but fail to converge uniformly. 
The conclusion of Corollary 60.5 may also be written 


lim lim f(x) = lim lim f(x) 


x7a n7 x 


For lim, _,,.f,(x) =/f(x) and since fis continuous, lim,_, f(x) = f(a). Also lim_,f,(x) =/,(a) since each 
function f, 1s continuous, and lim, |. f(a) = f(a). Therefore, Corollary 60.5 provides another example 
of a result which deals with interchanging limits. (See also Theorem 40.2 and the subsequent 
discussion.) 


Example 60.6 We let Cla, b]| denote the set of continuous real-valued functions on [a, 5]. We define a 
metric d on C[a, b] by the formula 


a(f, g) = lub {1f() — g()| |x € [a, 4]} 


Since the function f — g is continuous on [a, b], it is bounded, and therefore the least upper bound 
of the above set exists. The rest of the proof that dis a metric on C[a, 5] is straightforward (Exercise 
60.9). When we refer to Cla, 5], unless otherwise specified, we will assume that the metric on Ca, 
b] is that defined above. This metric 1s often called the metric of uniform convergence because of the 
next theorem. 


Theorem 60.7 Let {f,} be a sequence of functions in Cla, b]. Then lim,_,,.f, = in the metric space 
Cla, b] if and only iff, converges uniformly to fon [a, 5]. 


Proof. Suppose {f,' converges to f in the metric space C[a, b]. Let , > 0. There exists a positive 
integer N such that if n > N, then d(f,, f) < e. This means qf, ¢) = ub {Lf(x) — fC |x  [a, BY} < e> OT 
equivalently, f(x) — f(x)| < e for every x in [a, b]. By Definition 60.3, this says that f, converges 
uniformly to fon [a, 5]. 

Conversely, suppose {f,} 1s a sequence in Cla, b] which converges uniformly to a function f on [a, 
b]. By Corollary 60.5 we have that fe C[a,b]. We must show that lim,_,..f, =/1n the metric of Cla, b]. 

Let ¢ > 0. Since f, converges uniformly to fon [a, b], there exists a positive integer N such that ifn 
> N, then 


Lf) — fGd| < 2/2 for every xe [a, 5] 
Thus if 7 > N, ¢/2 is an upper bound for the set 
{| fale) — f(D] | x € La, b]} 
and so d(f,, f) < e/2 <¢. Therefore, lim, f/f, =f m 


Corollary 60.8 Cia, b| is a complete metric space in the metric of Example 60.6. 
Proof. The proof is left as an exercise (Exercise 60.10). m 


Exercises 


60.1 Prove directly from Definition 60.3 that the sequence in Example 60.2 does not converge 
uniformly. 

60.2 Let f(x) = 1/1 + n°x’) and fx) = 1/0 + n?x?) and g,(x) = nx(1 — x)", x €[0, 1]. Prove that {f,} and 
{g,} converge pointwise but not uniformly on [0, 1]. 

60.3 Prove that if the sequence {f+ converges uniformly to the function fon a set.X, then {f,} 
converges pointwise to f. 

60.4 Give an example of a sequence of continuous functions (on a metric space) which converges 
pointwise, but not uniformly to a continuous function. 

60.5 Let {f,} be a sequence of bounded functions ona set X. Prove that if {f,} converges uniformly 
to f on_X, then fis bounded. Give an example to show that this statement is false if uniform 
convergence is replaced by pointwise convergence. 

60.6 We say that a sequence {f,} is uniformly bounded on X if there exists M such that jf, (x)|< 


for all x ¢ M and for every positive integer n. 

Suppose that {f,} and {g,} converge uniformly to f and g, respectively, on X. 

(a) Prove that if each function f, is bounded, then fis bounded and {f/} is uniformly bounded. 

(b) Prove that {f, + g,} converges uniformly to f+ g on xX. 

(c) Prove that ifc ¢ R, then {cf,} converges uniformly to cf on X. 

(d) Prove that if {f,} and {g,} are uniformly bounded sequences on_X, then {fg} converges 
uniformly to f-g. 

(ec) Give an example to show that statement (d) is false if the boundedness hypothesis is 
removed. 

60.7 (Cauchy condition for uniform convergence) Let {f,} be a sequence of functions ona set _X. 
Prove that there exists a function f such that {f,} converges uniformly to fon_X if and only if 
for every ¢ > 0, there exists a positive integer N such that if m, n > N, then 


\fulx) — fn(x)] < ¢ for every x in X 


60.8° Prove Dini's theorem. Ifa sequence {f+ of continuous functions converges pointwise to a 
continuous function fon a compact metric space M and if f(x) => f,,,(x) for every x in M and 
for every positive integer n, then {f,} converges uniformly to fon M. 

60.9 Prove that Cla, b] is a metric space with d defined in Example 60.6. 

60.10° Prove that C[a, b] is a complete metric space with d defined in Example 60.6. 


61. Integration and Differentiation of Uniformly Convergent Sequences 
We first prove that the analogue of Corollary 60.5 holds for Riemann-Stieltjes integrable functions. 
Theorem 61.1 Let a be a function of bounded variation on [a, b] and let {f,| be a sequence of 


functions in g,[a, b] which converges uniformly to a function Then /f¢ g ,[a, b] and 


lim [fae = [fae 


nam a a 


The conclusion of Theorem 61.1 may be written 


lim iE de. = {. (lim f,) da 


where lim,_,..f, denotes the uniform limit of the sequence {/,}. 


Proof. First assume that a is increasing. If a(a) = a(b), there is nothing to prove; so assume a(a) < 
a(b). Let > 0. There exists a positive integer N such that 


E 
| f(x) — fr < 3[a(b) — a(a)] 


for all x in [a, b]. It follows that for any partition P of [a, 5] 


& 


US -fe Ps 3 IW - fy P< 5 


Since fy € #,{a, b], by Theorem 51.8 there exists a partition P of [a, b] such that 


Ufa P) — Lf, P) <5 


=lubf on [xj-4, x1 
M; = lub fy on [x;_,, xj] 
M;* = lub (f — tw) on [x;-1, x] 


If x Ee [Fe-05 x;) then 
F(x) = (F@) -— fr) + fr) <= MP* + MF 


and hence M, < M** + Mt 
It follows that 


U(f, P) = US — fu, P) + Uy, P) 


Similarly > Lf — fy, P) + Ly P) 
Using inequalities (61.1) feos (61.4), we have 


U(f, P) — Lf, P) s Uf — fy P) — LO — fu P) + Uf, P) - 


< |UCf — fas PDI + LL — fv POI + 3 


By Theorem 51.8, fs g ,[a, 5]. 
We next show that 


(where a is increasing). 
Let ¢ > 0. There exists a positive integer N such that ifn > N, then 


& 
LAG) — FOO < sy — ae) 


By Theorem 51.13(iv), if => N, then 


Ltn, P) 


(61.1) 


(61.2) 


61.3 
61.4 


. g 


b é 
[le —Slde s | sea 5 


Thus if n > N, then 


b g 
< | if-fldes5<e 


=|[ r= sae 


[fae - [fod 


If a is of bounded variation on [a, b], we let a = a, — a, be the decomposition of a as the 
difference of two increasing functions as in Theorem 54.8. By Theorem 55.2, f,¢ &,,[a, b] 0 &,,{a, 6] 
for every positive integer n. By our preceding result, £ ¢ &,,[a, b] 0 &,,[a, b], and hence fe g ,[a, b] by 
Corollary 53.4. Furthermore, 


lim | f da = lim (|4 da, — ie di, ) 


no n— oo a 


b b 
= tim [fe — lim | fats 


no moo 


= [fae - [fata | fe 


If {f,} is a sequence of functions which converges pointwise to a function fon [a, 5] and each f, is 
in ga, b], it may happen that f fails to be in g[a, b]. For example, let {7,, r,, . . .} be an enumeration 
of the rational numbers in [a, b]. Let 


0 if xe f{r},..., nt 


tak) = , if veteran 


Then f, € &,[a, 6] for every positive integer n, but the pointwise limit function 


0 if x is rational 


xji= 
fe) i if x is irrational 

is not in gla, b]. Some difficulties of this sort can be eliminated by considering a more general 
integral such as the Lebesgue integral (see Chapter XIV). See Exercises 61.1 to 61.4 for further 


examples. 
No analogue of Corollary 60.5 and Theorem 61.1 holds for differentiation. If we let 


then {f,} converges uniformly to 0 on [0, 1] (verify). However, f'(1) = 1++0. Other problems are also 
possible. We will show later (see Section 77) that there exists a sequence {f,} of infinitely 
differentiable functions on [0, 1] which converges uniformly to a function f that 1s nowhere 
differentiable in [0, 1]. 

The following theorem on differentiable functions is often quite useful. 


Theorem 61.2 Let {f,} be a sequence of differentiable functions on (a, 5). Suppose that 
(1) f', 18 continuous on (a, 5). 
(11) {f,} converges pointwise to fon (a, 5). 
(111) {f’,} converges uniformly on (a, 5). 

Then fis differentiable on (a, b) and f', converges uniformly to f’ on (a, 5). 


Proof. Let c € (a, b) and let c é (a, b). Let g denote the limit of {/,}. Then /* € @[c, x] (or g@[x, c]) since 


f,, 1s continuous. By Theorem 61.1, 


ia = filx) — file) (61.5) 
By the fundamental theorem of calculus 
| =f) - HO 


Using hypothesis (11), we have 


li | “Fi = lim [G0 ~ £0] = f@) - fO (61.6) 


mo Jo 


Combining equations (61.5) and (61.6), we have 
|. @=f0) -f0 


Differentiating each side of this equation, we have 


SOO=f'C) m 


Exercises 61.5 and 61.6 give other examples of phenomena that can occur with sequences of 
differentiable functions. 
Exercise 61.7 gives a less restrictive theorem on limits of differentiable functions. 


Exercises 


61.1 Give an example ofa sequence {f,} of functions in gla, b] which converges pointwise but 
not uniformly to a function fon [a, b] in gla, b] such that 


lim [=F 


61.2 Give an example of a sequence {f,} of functions in gla, b] which converges pointwise to a 
function fin gla, b] but 


lim [fe # [J 


61.3. Give an example ofa sequence {/,} of functions and a function f such that 
(a) f€ gla, 5] for every positive integer n 
(b) fe ala, 5] 
(C)limpso Bh = BS 
(d) lim, f(x) does not exist for any.x ¢ [a, b]. 
61.4° Let {f} be a uniformly bounded sequence of functions in g[a, b] which converges pointwise 
to a function fin gla, b]. Prove that 
tim fi fa= ['F 
61.5 Give an example of a sequence {f,' of differentiable functions which converges uniformly on 
R to a differentiable function f such that {f’, converges pointwise but not uniformly to /’ on 
R. 
61.6 Let 


SXx) = xt t MGA) —l<x<l,n2=—1,2,... 


Prove that {f,} is a sequence of differentiable functions on (—1, 1) which converges 
uniformly to f(x) = pq on (—1, 1), but /(0) does not exist. 

61.7 Let {f,} be a sequence of differentiable functions on (a, b). Suppose that the sequence {f(x)} 
converges for some xé (a, b) and that there exists a function g such that {/,} converges 
uniformly to g on (a, 5). Prove that there exists a function such that {f,} converges to f on (a, 
b) and that f(x) exists and equals g(x) for every x in (a, b). 

61.8 Use Theorems 58.5 and 60.4 to prove that if {f,} is a sequence of functions in g[a, b] which 
converges uniformly to fon [a, b], then f¢ g /a, b/. 


62. Series of Functions 


If {1}, 1S a sequence of real-valued functions on a set _X, we define the infinite series y=, y, to be 
the ordered pair ({u,,}, {s,,}), where 


Sy = Uy test Uy, 


This definition 1s identical to the definition (Definition 22.1) of an infinite series of real numbers 
with “sequence of real numbers” replaced by “sequence of real-valued functions.” As in Definition 
22.1, we call {s,} the sequence of partial sums. Convergence of the series y#_, y, is defined in terms 
of convergence of the sequence of partial sums. 


Definition 62.1 Let {u,} be a sequence of real-valued functions on a set X and let fbe a function on 
X. Let 


Sy = Uy treet uy 


We say that y*, u, converges pointwise to f on X if the sequence of partial sums {s,} converges 
pointwise to fonXx. 
We say that y*_, y, converges uniformly to f on X if the sequence of partial sums {s,} converges 


n=1 


uniformly to fon X. 
Theorems 60.5, 61.1, and 61.2 may be used to give corresponding results about series. 


Theorem 62.2 If {u,} is a sequence of continuous functions on a metric space M and if y@, u, 
converges uniformly to fon M, then fis continuous on M. 


Proof. By Theorem 40.4, the sequence {s,} of partial sums of the series y*, y, iS a sequence of 
continuous functions on M. By Corollary 60.5, fis continuous on V/. ™ 


Theorem 62.3 Let a be a function of bounded variation on [a, b] and let {u,} be a sequence of 
functions in ga, b]. Ify2, x, converges uniformly to a function f on [a, b], then feg ,[a, b] and 


a n=1 


b Cs] b 
| fa=F | u, dt 
Proof. Use Theorem 61.1. my 


Theorem 62.3 is often summarized by saying that a uniformly convergent series may be integrated 
term by term. 


Theorem 62.4 Let {u,} be a sequence of differentiable functions on (a, 5). Suppose that 
(1) wu’, 1s continuous on (a, 5). 
(ii) 2, w, converges pointwise to a function fon (a, b). 
(ili) y*, uw, converges uniformly on (a, 5). 

Then f is differentiable on (a, b) and 


@m 


f'@) = Y uw) 


n=l 
for every x in (a, b). 
Proof. Use Theorem 61.2. my 


We may deduce a necessary and sufficient condition for uniform convergence of an infinite series 
from the Cauchy condition (Theorem 19.3). 


Theorem 62.5 Let {u,,} be a sequence of functions on a set _X. Then 2, », converges uniformly on _X 
if and only if for every ¢ > 0, there exists a positive integer N such that ifm > m > N, then 


<é (62.1) 
for every x nx. 
Proof. Let s, = u, +++++ 4, denote the nth partial sum of the series y*_, x. 
First suppose that y# _, ,, converges uniformly to fon_X. Let g > 0. There exists a positive integer N 
such that if n > N, then 
In) — FO) <5 


for every x eX. Thus ifn > m= N, then 


2.00 


= |s,%) — Su(*)| 

< |sx0) — SO) + |G) — Sul 
ha 

< 3 + 3= & 


for everyx eX. 
Now suppose condition (62.1) holds. Let g > 0. There exists a positive integer N such that ifn > m 
> N, then 


& 
<= 


| Yue] <5 


for every y2, u,- Since Y"_ 444 w(x) = 5,(x) — s,(x), it follows that if y"_...., w(x) = 5,(x) — s,(x), then 
{S,(x)} is a Theorem 19.3, the sequence {s,(x)} converges for every x ¢ X. Let f(x) = lim,.,, s,(x) x € 
X. We will show that {s,} converges uniformly to fon_X. (So far we only know that {s,} converges 
pointwise to fon_X.) 

Let x e X and let m > N. Then 


mt 


sa) — fool =|F 4G) — F nbd 
k=1 ke1 
=| 3 x@l=tm| 5 40 
komt+1 uoo fk=mt+1 
< & 
s 2 = E& 


Thus if m => N, then 
Sux) — f(x) < € 
for every x ¢ X. Therefore, {s,} converges uniformly to fon_X. 


An important sufficient condition for uniform convergence of a series of functions is given in the 
next theorem. (See Exercises 62.3 and 62.4 for other conditions which yield uniform convergence.) 


Theorem 62.6 (Weierstrass M-Test) Let {u,} be a sequence of functions on a set _X. If there exists a 
sequence {M_,' of positive numbers such that y=, “, converges and jw,(x)| < M, for every x eX and 
for each positive integer n, then y#_, ,, converges uniformly on_X. 


Proof. We show that the series y#_, y, satisfies the hypotheses of Theorem 62.5. Let ¢ > 0. Since 
52, M, converges, there exists a positive 
integer N such that if > m = N, then 


Minti se t= 8 


Ifn >m>Nandx ¢eX, then 


[tn + 1.20) a stek u,{x)| = | tne + i()| eee = jz,,(x)| 
= Mavi tere $ M, =e 


and so by Theorem 62.5, y#_, y, converges uniformly onX. q 


As an example of the use of the results of this section, we will give an example of a function which 
is continuous on R but differentiable at no point of R. 

Let f,(x) be the distance from x to the integer nearest x. (See Figure 62.1.) 

We observe that f/, is continuous on R, f,(x + NV) =/,(x) for every integer N, and | f,(x)| < 4 for every 
x €R. Let f(x) =fo(4°x)/4 for x ¢ R. andk=1,2,.... (See Figure 62.2.) 

Then f, is continuous on R and jf,(x)| < 1/(2-4*). By the Weierstrass M-test (Theorem 62.6), r2., f; 
converges uniformly on R. Since each f, is continuous on R, the limit function, which we denote by F, 
is continuous on R (Theorem 62.2). We will show that F' is nowhere differentiable. 

Let us define a “roof” of f,, to be the graph of f, over [n/(2°4”), (n + 1)/(2:4”)] for some integer n. 
(See Figure 62.3.) 

We note that if x and y are under a roof of f,, then (x, f,,(x)) and (y, f,,(v)) 


_1/3 
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Figure 62.2 
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Figure 62.3 


lie on a line segment which has slope either +1 or —1 and hence [f,(x) — f,,(v)/(x — vy) =+ 1. (See 
Figure 62.2.) Furthermore, in this case, x and y are under a roof of f, for k < m, so that 


fi) — AQ) _ 
x-y | 


+1 for k<m 


Let a ¢ R. Let m be any positive integer. Then 2€[”/(2-4"""), (# + D/ (2:4""")] for some integer 7. 
Since the length of this interval is 1/(2:4”"'), by taking h,, =+ 1/4” or —1/4”, we can assure that a and 
he, € [n/(2-4"~*), (2 + 1)/(2-4"-4),. We showed above that, in this case, 


MAC Tl MO) for kK<m 


Ifk =m, 


fila + hin) — f@) = 


_ foldta +N) — fol4*a) 
4* 


fol(4'a + 4 hp) — fo(4'a) 
4k 


for some integer WN. It follows that f,(a + h,,) —f,(a) = 0 for k > m. Therefore, 


F@ + fn) — F@ _ Ss fila + hn) — fA) 


Pay k=0 Ay 
mm Sila + hy) — fia) ™! 
sy ewe Ft 
2 he, 2» " 


Thus [F(a + h,,) — F(a)]/h, is an odd integer if m is odd and [F(a + h,,) — F(a)]/h,, is an even integer 
if m is even. It follows that lim, _... [F(a + h,,) — F(a)]/h,, does not exist. If F were differentiable at a, 
then this limit would exist. Consequently, F' is differentiable at no point of the real line. 


Exercises 


62.1 Prove that the series 72, 1/(? +- x?) converges uniformly on [0, 00). 
62.2 Prove that the series rz, x"(1 — x) converges pointwise but not uniformly on [0, 1]. Prove that 
Hz, (—1)’x"1 — x) converges uniformly on [0, 1]. 


62.3 Lety=, u, and rz, », be series of functions ona set_X such that u,(x)| < v,(x)| for every 
positive integer n and for every xe_X. Prove that if y= , |y,¢.)] [V,| converges uniformly on_X, 
then y=, w, converges uniformly on X. 
62.4° Prove Dini's theorem for uniform convergence of series: 
Let {u,} be a sequence of nonnegative continuous functions on a compact metric space M. If 
y2, vu, converges pointwise to a continuous function fon M, then y*_, y, converges uniformly 
to fon M. 
62.5 Fill in the details of the following proof of the Tietze extension theorem for metric spaces. 
Theorem Let f be a continuous function from a closed subset C of a metric space M into [—1, 
1]. Then there exists a continuous extension of f from // into [—1, 1], (that is, there exists a 
continuous function g from M into [—1, 1] such that g) C =f). 
Proof 
(a) Let A = {xeC| f(x) < —4) and B= {xe C| f(x) > 3}. Modify Exercise 40.14(c) to conclude that 
there exists a continuous function /, from M into ,—4, 4] such that ¢, = —4 0n A and z on B. 
(b) Show that | fe) — A,69| < ¢ for all x eC. 
(c) Repeat (a) and (b) with freplaced by f — f, to find a continuous function /, from / into 
[—g, 4] Such that f, is —3 on freC| f(x) — A@) < —3} and f, is 2 on {xe C] f(x) — Als) = 3} and 


fi) < —d} and fA is on {xe C| f(x) — A(x) = $} and 
lf@) -—[h@) + AQ] <$ = forallxec 


(d) Show that there exists a sequence {f} of continuous functions on M such that (1) the range 
of f, is contained in [—2” '/3”, 2” '/3"]; (ii) f,,, is —2”/3”"' on 
(xe Cl f(@) —LA@) +++ +40) < —243"4 and f,,, 1s 2"/3""! on 
{xe Cl FG) — iG) +--+ ACO) = 273" 45 and (111) |f@) — LAG) +--+ + Ad] < @" for all xe C. 
(e) Prove that y=, ¢, converges uniformly to a continuous function on M. 
(f) Prove that g y=, f, 18 a continuous extension of fto M into [—1, 1]. 
62.6 Let M bea metric space. Prove that Mis compact if and only if every continuous real-valued 
function on M is bounded. 
62.7 Suppose that »=., a, converges pointwise ona set X. Suppose also that {uw} converges 
uniformly to zero on_X. Must y*_, », converge uniformly? 


63. Applications to Power Series 


We recall that a power series is a series of the form »* , a(x — 1)" (see Sections 27 and 29). If R is 
the radius of convergence of a power Series y™ , a(x — 1)", then >, a,(x — ry" converges absolutely if 


ph — 4 <R and diverges if ~ — 4> R (see Section 27). We will use the results of Section 62 to prove 
that a power series may be integrated or differentiated term by term for p — 4< R. 


Theorem 63.1 Let y™, a(x — 1" be a power series and let R be its radius of convergence. Let 
FQ) = Timo a(x — t)', [x — t] < R Then 
(i) If0<S<R, then y* , a(x — 1" converges uniformly to fon [t — S, t + S]. 


(11) fis continuous on (t — R, t + R). 
Gui) If abe@—R,t+R),a<b, and a is of bounded variation on [a, bd], then 
Se Bla, bl, Do a, §° (x — t) da(x) converges and 


” Pd y«, ” oe = 1)" d(x) 
[fe— 36 


n= 


(iv) fis differentiable on (t — R,¢t + R), 5“, na,(x — t)"~1 converges absolutely ifp — 4 < R, and 
f@=Y ne-yo, [x-t<R 
n=1 


Proof. (1) Suppose 0 < S < RK. Ifp — 4 <S, then ja,(x — 1)" < ja,S”. Since 0 < S < R, >, Ja|s” 
converges. By Theorem 62.6, », a,(x — ry" converges uniformly on [t — S, ¢ + S]. 

(11) Suppose 0 < S < R. Each function w,(x) = a,(x — f)" 1s continuous on [t — S, t + S]. By Theorem 
62.2, the uniform limit fis continuous on [t — S, ¢ + S]. Since fis continuous on [¢t — S, t + S] for 
every S,0<S< R, it follows that fis continuous on (t — R, t + R). 

(111) The proof follows immediately from Theorem 62.3. 

(iv) By Theorem 27.2, the radius of convergence of the power series y* | ng (x — ryr~1 1S 


1 
lim sup |na,|7™ 


no 


In — 


Since lim, _,,, 2" = 1, by Theorem 20.8, lim sup, .,ja,j’”” = lim sup, ,_,Ja,|"”. Thus 


I 1 
~ lim sup Ja,|'" ~ lim sup |na,|*"" 
n> oD an @ 


and hence y | ng (x — ryr-1 converges absolutely ifp — 4< RK. Let u,(x) =a,(x — 1)" and let0<S<R. 
Then 

(a) u' (x) =na,(x — t)""' is continuous on (¢t — S, t +S). 

(b) y2, w, converges pointwise (in fact uniformly) to fon (t — S,¢ +S). 

(c) y*, w, converges uniformly on (t — S, t + S). 
In (b) and (c) we have used part (1) of this theorem. By Theorem 62.4, fis differentiable on (t — S, t 
+ S$) and 


o 8] 


fie = Yona, -il<s 
n=1 


Part (iv) now follows immediately. m 


Examples. Consider the geometric series 


-14 28-38 4---= (5) Ix] < 1 


By Theorem 63.1(iv), we have 


-142e— 3x? +---= DL) =a |x| < 1 
We will show in the next chapter that 
| qqat= oe + 2, x>—-—l 
ol +t 
By Theorem 63.1(111), 
log tyex-F+h-..= FCN |x| < 1 


Corollary 63.3 (Uniqueness of Power Series) Suppose the power series y# a(x — 1)" and 
E20 ,(x — ty converge for pp — 4< RK. Ifye a(x — = D2 b,(x — 2)" for all x, p — 4< RK, thena, = 
b, for every nonnegative integer n. 

Proof. Taking x = t in the equation 7® 4 a,(x — 1)" = Yq b,(x - ry, we find that a, = by. By Theorem 
63.1(iv), 7%, na,(x — ty") = 32, nb,(x — 13, |x — t] < Ro pe — 4< R. Taking x = ¢ in this equation, 
we find that a, = 5,. Similarly, a, =b,,a,=b,,....™ 


Corollary 63.3 Suppose the power series y2,a,(x— 1)" has radius of convergence R. Let 
f@) = T%, a,(x — t)", |x — t] < RB. Then 


SO) = F na —Dn-D---G@—mst Dalx-1-", x1 <R 


form=1,2,.... 


Proof. The proof follows from m applications of Theorem 63.1(iv). gy 


Corollary 63.4 (Taylor Series) Suppose the power series y* , a,(x — 1)” has radius of convergence R. 
Let fx) = 0%, a,(x — t)", Ix — t] < R. Thena, =f”(0)/n!, and hence 


f(t) 


n! 


cn y (e—1 for e—-t<R 


Proof. By Corollary 63.3, 
FOC) = Y nla —1)--- (2 — m+ Na, = cn 


Exercises 


63.1 (a) Prove that the series ~, (2%n." has radius of convergence ©. 
(b) Let rz, (2%n2.. Prove that f(x) = 2f(x). 


63.2 Prove that 


za+1 


1 [=12 
teat = 2, Geer fore <1 


63.3 Suppose that the series 52. a,x* converges. Prove that the equation f(x) = D&0 a,x", |x| < R. 
defines a continuous function on (—1, 1). 

63.4 Prove that if the series 52, a,x converges absolutely, then 52, a,x" x "converges uniformly 
for py < 1. 

63.5° Let [2.4,x"x "be a power series with radius of convergence R. Let 52.5 agx* X "|x] < R. 
Prove that if fis not constant the zeros of fare isolated [that is, prove that if f(a) = 0, ja < R, 
there exists an open interval / such that ¢@¢ 7c (—R, R) and f(x) + O if xe I — {a}). 

63.6 Suppose the power series P25 a,x" and Y2, b,x" converge for py < R and that 
Veo ax" = Y%, b,x" for all x belonging to an infinite subset of [—R + 2, R — e| for some ¢ > 0. 
Prove that 72, a,x" = 0%, 6,2" for all x, py < R. 

63.7 (Binomial Series) Let a be a real number. Let (g) = 1 and 


n n! 


(4) = Mea ewe 


ifn = 1 and nis a positive integer. 
Notice that if a =n and a is an integer, (2) is the ordinary binomial coefficient. 
(a) Prove that the radius of convergence of the binomial series y2., @. 1s 1 (assuming a is not 
a nonnegative integer). 
(b) Let fax) = N20 x’, |x| < 1. Prove that /(0) = 1 and 


af = (1+ xfx) xf <1] 
(c) Let fbe any function satisfying 


fQ) = 1 
af(xy)= (14+ xf) [xl <1 


Prove that f(x) = (1 + x)*, pq< 1. 
(d) Deduce that 72, (@)x" = (1 + x)* for any real number a and any x, py< 1. 
(e) Investigate the convergence of the binomial series for x = +1. 


64. Abel's Limit Theorems 
In Section 63, we showed that 


i 
= |x| < 1 


log (1 + y= FS 


We will show in the next chapter that log is continuous in (0, 0%) and thus 


lim log (1 + x) = log2 
z+1 


If we substitute 1 for x in the power series p=, (-1)"*!x'/n, we get the convergent series 
2 (-1)""4x%/n, We might ask whether 


_ fa] (—1)"*? 
log 2 = Be == 
This is equivalent to asking whether 
oa —_ pyri oO —1y¥tl 
x71 n=1 hn n=1 43 


Corollary 64.3 states that this substitution is valid. 


Theorem 64.1 (Abel's Test for Uniform Convergence) Let {u,} be a sequence of functions on a set 
X such that y#., x, converges uniformly on X. Let {v,} be a uniformly bounded sequence on X such 
that v,,,(%) < v,(x) for every x in X and for every positive integer n. Then y@, u,v, converges 
uniformly onX. 


Proof. We will use an analogue of the summation by parts formula (Theorem 28.1), replacing 
Yz-, by Y7_,,4, 80 that we can apply the Cauchy condition for uniform convergence (Theorem 62.5). 
Let {a,} and {b,} be real sequences. Let 


k 
Sk _ 2, Sis j s kK 
m= 


As in Theorem 28.1 we can prove the formula 


>; a, ad a Sint 1 e(By an B41) ss Sint tnPnt 12 mon (64.1) 
k=mt1 kK=ne+1 

Let x e X, let a, = u,(x), and let b, = v,(x). Let M be a positive number such that jv,(x)j < M for 
every x ¢ X and for every positive integer n. Suppose ¢ > 0. There exists a positive integer N such that 
ifn >m=N, 


& 


2.80) < air 


Now ifn > m=N, then 


F u(xdo(x) 
kemv7t 


px Sot xMO(x) — 044,163] + Sn +1 On +1) 


k=m+1 
nn 


< 


kem+l 


[Svs nM) — 44 CL + Se -PIHP9 +1 
S 357 ,_>, ,[u@) — vos] + 57M 


= 557 lmer) — M4100] + 5 


& € 
<q t+ M)+3=8 


By Theorem 62.5, 2, u,v, converges uniformly on X. m 


Corollary 64.2 (Abel's Theorem) If ¥*., a, is a convergent series, then the power series F725 a,x" 


converges uniformly on [0, 1]. 


Proof. Let u,(x) = a,, and »,(x) = x", x €[0, 1] and then apply Theorem 64.1. 


Corollary 64.3 (Abel's Limit Theorem) Let »%., a, be a convergent series. Let 


Then lim /@) = 0) = a, 


fo= Vax, O<x<l 
a=0 


Proof. By Theorems 64.2 and 61.5, fis continuous on [0, 1]. m 


Corollary 64.4 Suppose that the power series 52, a,x" converges for some T# 0. Let 


Then lim f(x) = f(T) = 3 a,T" 
x-T nad 


Proof. Let 


By Corollary 64.2, 


or x=T 


fo) = ¥ a,x’, 


n=0 


|x| < [T| 


a 


g(x) = ¥ a,T*x", 


nad 


Cs :5 1] 


lim g(x) = g() = ¥ 4,7" 
x71 n=0 


Now A(x) =x/T 1s continuous at x = T and g is continuous at x = 1; so f= go 1S continuous at x = 
T and the conclusion now follows. ™ 


Exercises 


64.1 Prove equation (64.1). 

64.2 Give an example of a divergent series 7%, a, such that 52, a,x" converges if p< 1 and 
lim,.; (Zo a,x") Exists. 

64.3" Let r= a, and £2, 4, be convergent series and let y=, ¢, denote the Cauchy product of 
M29 & and 2, 6, Prove that if yz, ¢, converges, then 


Compare this result with Theorem 29.9. 
64.4° Prove Dirichlet's test for uniform convergence: 
Let {u,} be a sequence of functions on_X. Suppose that the sequence {s,} of partial sums of 
the series y=, y, is uniformly bounded on X. Let {v,} be a sequence of functions on_X such 
that v(x) < v,(x) for every x in_X and for every positive integer n. Suppose also that {v,} 
converges uniformly to 0. Then the series y=, u,v, converges uniformly on_X. 


65. Summability Methods and Tauberian Theorems 


Consider the divergent series y* , (—1)*.. Ifpq< 1, then y=, (—1)"x" converges and 


n=O 


dX (-y ieee: | pa 
Since lim,.., 1/1 + x) = 4, We can assign $= , (~1)* the generalized sum of }, This summability method 


is known as Abel summability. 


Definition 65.1 If ya, is an infinite series such that D2,a,x" converges if py < 1 and 
lim, D9 a,x" = T exists, we say that y=, a, 1s Abel summable (to T). 


By Corollary 64.3, if ©=., 4, converges to L, then the Abel sum and the ordinary sum (Z = 9%, a,) 
are the same. Thus Abel summability generalizes the ordinary method of summing an infinite series 
(Definition 22.2). 

Another generalized sum is the Cesgro sum. 


Definition 65.2 Let y=, a, be an infinite series. Let {s,} be the sequence of partial sums of the series 
¥2.> 4, Iflim,,.. (s, +s,+: ++ +,)/n = T exists, we say that is Cesgro summable (to T). 


By Theorem 20.7, if 5%, a, converges to L, then the Cesgro sum and the ordinary sum (Zz = Y%., a,) 
are the same. The divergent series “=, (— 1)" has Cesgro sum }, (verify), and thus Cesgro summability 
also generalizes the ordinary method of summing an infinite series. Cesgro summability plays an 
important role in the theory of Fourier series (see Chapter XII). 

It can be shown that if y*,, ¢, is Cesgro summable to 7, then p*., a, 1s Abel summable to 7, but that 
there are Abel summable series which are not Cesgro summable (see Exercises 65.1 and 65.2). 

Theorem 64.3 can be rephrased as follows: If y.,4, converges to L, then »*,,4, 1s Abel 
summable to L. The series »_,(-—1)" shows that the converse of this theorem is false. If certain 


additional hypotheses are imposed, it is often possible to deduce that y=, 4, converges. Such a 
theorem is called a Yauberian theorem and the additional hypotheses are called Yauberian 
conditions. There are very complicated Tauberian theorems which play an important role in higher 
analysis. We shall give one example now of a Tauberian theorem and another later Theorem 79.1). 
Other Tauberian theorems are given as exercises (Exercises 65.3 and 65.4). 


Theorem 65.3 (Tauber's First Theorem) If y=, a, is Abel summable to 7 and lim,_,. na, = 0, then 


=, 4, converges to 7. 
Proof. Let 


_ la,| + 2|a,| +---+ nla,| 
h 


f(x) = ¥ ax" for {xj <1 


it 


Since lim, _,,. nja,|= 0, by Theorem 20.7, lim,_,,. o,, = 0. By hypothesis lim,_,,. f1—-(1/n)) = T. 
Let , > 0. There exists a positive integer N such that ifn > N, then 


& 


é 
3 em 


r(n-3)-7< 3? nlayl <5 


Lets =a, 7a, 7+*** ra, Then p<, 


s,- T=f(x)- T+ y afl — x‘) — sr a,x* 
=9 


k=nt+1 
Also, if 0 <x <1, then 
Q-x)=(-—-xyU+x4---4 x2 < kl —» 


Therefore, ifn > N and 0 <x <1, then 


i — Ths I/@) — T1409) Y Had + gq 


Now ifx=1-1/nandn > N, then 


Exercises 


65.1 Prove that the series 72. , (—1)"*1” 1s Abel summable to 3, but is not Cesgro summable. 
65.2 Prove that if the series »*,, a, 1s Cesgro summable to 7, then »=., a, 1s Abel summable to 7. 


65.3 


65.4 


65.5 


If ys, a, 1s Abel summable to 7 and a, > 0 for every nonnegative integer n, prove that 5%, a, 
converges to T. 

Prove that an infinite series »*., a, converges to Tif and only if y=, a, is Abel summable to 
T and 


lim @ + 242 +++--+ Nay _ 0 
Nowa N 


Investigate the theorems of Chapter V where ordinary summability (or convergence) 1s 
replaced by Abel summability or Cesgro summability. (For example, if y=, 4, and r=, 4, are 
Abel summable to A and B, respectively, is 72.4 (a, + 5,) Abel summable to A + B?) 


Xl 


Transcendental Functions 


In this chapter we introduce some special real-valued functions on R. 
66. The Exponential Function 
Definition 66.1 For eachx ¢ Rwe define 


nie Sg 
expx= ) = 
wai n! 


By Theorem 26.6 we know that exp (x) converges absolutely for all x in R. We also know, from 
Corollary 29.10 on the Cauchy product, that for each x, ye R,, we have 


Swe yy 2- 2x 
expxexpy= Doi Lai 2 oki — Oo! 
2 (x + y)" 
=e aT = exp (x + 9) (66.1) 


Clearly exp 0 = 1 and since for each x in R we have [by equation (66.1)], 
exp x-exp (—x) = exp (x — x) = exp 0 = 1, we conclude that 


exp x # 0 for all x in R 182-3} 


and exp (-~ IixinR_. ; ; 
Let us 2 Sane the differentiability of exp. We have by Theorem 63.1 (iv) that exp’ x exists for all 


x ¢ R and 


Therefore, exp is differentiable for all x in R and 
exp’ x = exp x (66.4) 


Therefore, exp x is continuous on R. This along with exp 0 = 1 and exp x # 0 for all x & R and 
Corollary 45.6 implies that 


expx > 0 for allxeR (66.5) 


Theorem 66.2 exp | =e. 


Proof. From Theorem 16.6 we have e = lim,_,,, (1 + I/n)". Let Let @, = Yx_, I/k!and b, = (1 + I/n)" 
forn=1,2,.... We must show that lim, ,,. a, = lim,_,,, b,. By the binomial theorem we have 


—_— 
| 
1 


asf, 1 2 lf, Li lcwtooe 
cin ee A ae | ~ al rz] 


1 
siltlt+at yt se for n=1,2,... 
: ; = (yy 
S0e¢ = lim 4, < lima, = 5 OF capil 
no n+a n=0 #t 


We now prove the reverse inequality. For each m <n, positive integers, we have 


| 1 1 1 n—l 
= 1+1 45 (1-5) eta (1-2) (1 Pa ) 
5 qarqcn Ny as | oe ,-"a! = Cra 
2! n ! it a . 


For fixed m we have 


1 
e=limj, > lime, ,=l+1+—+4+---+ 


aoe ee 2! mi om 
Therefore e>lim,, .., a,, =exp 1. m 
For each positive integer n we have by equation (66.1), 
e" = e-e---¢ = exp l-exp1---exp1 = exp(1 + 1+---+ 1) = expan (66.6) 
and by equation (66.3), 
= J 1 
ea pg 7 PCH) (66.7) 


Therefore for any rational number r = m/n (where n > 0), we have by equations (66.1) and (66.6) 
or (66.7) 


(exp r)" = expr --+- expr = expur = e” 


therefore, exp r = (e””)'" = e". We conclude that 


expr =e" for any rational number r (66.8) 


Let a be any real number. Choose {r,}=,, any increasing sequence of rational numbers such that 


lim +, = « 
By Section 17 and equation (66.8), we have 
ex = lim e’* = lim expr, = exp (lim 7,) = exp « 
n-? a now now 
Therefore 
expa=ea for any real number a (66.9) 


By equations (66.8) and (66.9) we have the following theorem. 


Theorem 66.3 exp x = e* for everyx ER. 

Since e > 2 and e* is strictly increasing, we have lim_,,, e* = 0%. By equation (66.3) lim_, ,, e* = 0. 
By the intermediate value theorem (Corollary 45.6) it follows that the range of e* is (0, 0). 

In Figure 66.1 we have sketched the graph of e*. 

We now summarize the above results. 


Theorem 66.4 
(i) *=y2,x%alforallxeR. 
(11) e* is continuous and differentiable for all x in R. 
(iu) (e*)'=e* for allxeR. 
(iv) e* is strictly increasing on R and e* > 0 for allxeR. 
(v)e*” =e*- e’ for all x and y inR. 
(vi) lim_,,, e* =o and lim, , e*=0. 


Exercises 


66.1 Suppose f: R — R and f(x) =/(x) for all x ¢ R and f(0) = 1. Prove that f(x) = e* for allxeR. 


1 


Figure 66.1 


66.2 Prove lim,_,,. (1 +x/n)"=e* forallxeR. 


66.3 Suppose f(x) : f(v) =f(x + y) for all x and y in R. Assuming fis differentiable on R and not 
zero, prove that f(x) = e“, where c is some constant. 

66.4 Do Exercise 66.3 with differentiable replaced by continuous. 

66.5 Evaluate fe e-c-tis gy, 

66.6 Prove that lim, x”e* = 0 for every positive integer n. 

66.7 Suppose that 7’(t) = c7(t) for ¢ in an interval containing zero. Show that 7(t) = T(0)e“. 


66.8 Suppose that f(x) > xf(x) for all real x. Prove that there exists a constant k such that ke* < f(x) 
for every real x. 


66.9 Let 


faya{er" x #8 


Prove that f”(0) =0 forn=1,2,.... 
67. The Natural Logarithm Function 


In Section 66 we showed that e* = exp x 1s a strictly increasing function from R onto (0, ©). 


Therefore, exp has an inverse function from (0, 0) onto R. This section is devoted to the study of this 
inverse function. 


Definition 67.1 We define 


logx =exp''x for xin (0, 0) 
We call log the natural logarithm function. 


Theorem 67.2 
(1) logis a strictly increasing, continuous, differentiable function from (0, 0) onto R. 
(11) log’ x = 1/x for x in (0, 0). 
(111) log 1 =0 and loge = 1. 
(iv) log xy = log x + log y for x and y in (0, 0). 
(v) logx”’ =r log x — log y for x and y in (0, «). 
(vi) log x" =r log x for x in (0, 0) andr in R. 
(vii) lim_,,, log x = —oo and lim_,,, log x = 0%, 


Proof. For convenience of notation, in this proof we will denote log x by L(x). 
By Theorem 66.4 for eachy inR 


exp’ y = expy > 0 


By Theorem 49.10, 


I 
exp’ y ~ exp y 


L'fexp y) = 


Let x ¢ (0,00). There exists a unique y in R such that exp y = x. Therefore, L'(x) = 1/x. Parts (1) and (i1) 
now follow. 

Since exp 0 = | and exp 1 =e, part (111) follows. 

Ifx , y € (0,0), we have 


exp [L(x) + L(y)] = exp [Z(x)] exp [Z(y)] = xy = exp [Z(xy)] 


and since exp 1s one to one, it follows that 


L(x) + L (y) = Lay) 
If xe (0,00) andre R, we have 
exp [L(x")] = x" = (exp [L(x)])’ = exp [rZ(x)] 


and thus L(x") = rL (x). 

Part (v) follows from parts (iv) and (v1). 

Part (v1) follows from Theorem 66.4(v1). gy 

The functions exp and log are examples from the classes of exponential and logarithm functions. 
(See Exercises 67.4 and 67.5). 

Figure 67.1 is a sketch of the graph of log x. 


Exercises 


67.1 Suppose g(xy) = g(x) + g(y) for all x and y in (0, ©). Assuming g is continuous on (0, 0) and 
not constant prove that g(x) =c logx for some c inR. 


log{x) 


Figure 67.1 


67.2 Prove that lim_,, x” log x = 0 for every positive integer n. 
67.3 Prove that fz (1/#)d¢ = log x for x in (0, 0). 


67.4 Leta>0. 
(a) Show that a* = e* log a for x inR. 
(b) Prove that (a*)' = (log a)a’. 
67.5 Leta>0Oanda# 1. Define log, to be the inverse function to a*. We call log x the logarithm of 
x to the base a. Compute the derivative of log x. 
67.6 Leta>O0 and let f(x) =x‘ for x in (0, 0). Prove that f(x) = ax*!. 
67.7 (a) Let f(x) =log (1 +x). Apply the mean-value theorem to fon [0, 1/n] to conclude that 


nlog (1 +i)=; a 


where 0<c < I/n. 
(b) Use (a) to prove that 


(c) Letc, =1 +35 +:++1— loge 


By considering C,,,, — C, and D,,,, — D, and (b), prove that {C,,} 1s decreasing and {D,} is 
increasing. 
(d) Prove that {C,} is bounded below and that {D,} is bounded above. Deduce that {C,} and 
{D,} converge to a common limit. This limit is known as Euler's constant and is denoted 
). 
67.8 (a) Derive the following expansions valid for py< 1: 


log (i +x) = PH cp. 


4] k 

log (1 — x) = — 2a 
Ls) 25 & x= 
log (73) = 2.) 2 


(b) Show that the error 2 »2.,,, x?#-1/(2k — 1) in approximating log ((1 + x)/(1 — x)) with n 
terms of the last expansion in part (a) is at most 


yen 
(2” + 1)(1 — x7)° 


(c) Derive the expansion 
Siig Dee eee ae 
aa, 3*—-*(2k — 1) 


Show that if we take six terms of this expansion, the error is less than} x 19-s,. Compare 


this result with Exercise 25.5(e). 


68. The Trigonometric Functions 
We begin by defining two power series functions, which turn out to be the functions sin x and cos x. 
Definition 68.1 For eachx ¢ R we define 


2n+1 3 7 


= n * x x3 
= BV aaa ea a 


=| 
+ 


; ea 


= x me oe 
ance). Zobtes Un@abke absoilicl yifor @ll values of x by the ratio test. Since the reader is probably 
familiar with the properties of the functions sin x and cos x, we will proceed in justifying Definition 
68.5 by showing that S(x) and C(x) have all those familiar properties and that they are the unique 
functions with those properties. 
From (68.1) and (68.2) we see that 


C0)=1 Ss@d=0 (68.3) 
C(-x) = C(x) S(-x) = —S(x)__ forallxeR (68.4) 

and by Theorem 63.1(iv) 
C(x)=—-S(X) = S'(x) = CQ) _~—OsforallxeR (68.5) 


Lemma 68.2 [S(x)]? + [C(x)]? = 1 for allxeR. 


Proof. Let g(x) = [S(x)]? + [C(x)} for all x e R. By (68.5) and the 
chain rule 


g'(x) = 2S(x)C(x) + 2C(x(—S(x)) = 0 ~—forallxeR 
By Theorem 49.9, g(x) is a constant function on R; however, 
g(0) = 1; so g(x) = 1 foralxeR m 


Lemma 68.3 If fis a real-valued function on R satisfying f(x) = —f(x) for all x e R and f(0) = 0 and / 
'(0) = 5, then 


f(x) = bS(x) —sforalixeR 


Proof. If we let U(x) = f(x)S(x) + f'(x)C(x) 
and V(x) = f(x)C@) — f')S(@) 


it is easily verified that 


U(x) = 0 = V(x) for allxeR 
Therefore, we have 
b = f(x)S(x) + SCO) 


and f(x)C(x) = f'(x)S(x) for allxeR 
Using Lemma 68.2, we conclude that 


bS(x) = S)LFO)S(®) + f'A)CO)] 
= f0d{1 — [CO)P} + f’IS@IC) ” 
= f(x) — COMNPE)CO) — f')S@)] =f) forallxeR 


Theorem 68.4 If fis a real-valued function on R satisfying f(x) = —/(x) for all x ¢ R and f(0) = a and 
f'(0) = 5, then 


f(x) = aC(x) + bS(x) ~~ forall xeR 


Proof. Let g(x) = f(x) — aC(x). Then g'(x) = —g(x) for all x ¢ R and g(0) = 0 and g'(0) = 5; so by 
Lemma 68.3, we have 


g(x) = bS{x) = forallxeRm 


Theorem 68.4 justifies the following definition. 


Definition 68.5 We define for all x ¢ R the functions 
sin x = S(x) cosx=C(x ) 


and we call these functions the sine and cosine, respectively. 
We proceed by proving many of the formulas involving sin x and cos x. 


Theorem 68.6 sin (x + y) =sinx cos y+ siny cos x for all x and y inR. 


Proof. Fix y in R and let f(x) = sin (x + y) for all x in R. Then f(x) = — f(x) for all x e R and f(0) = sin 
y and f'(0) = cos y; so by Theorem 68.4 we have 


f(x) = sin y cos x + cos py sin x for allx and yinR g 
Theorem 68.7 cos (x + y) =cos x cos y— sinx sin y for all x and y inR. 
Proof. Fix y in R and let g(x) = sin (x + y) for all x e R. By Theorem 68.6, g(x) = sin (x + y) = sin x 
cos y + siny cos x; so g(x) = cos (x + y) =cos x cos y— siny sin x for all x and yinR. gq 


We now define the real number z. 
It is easily verified (see Exercise 25.3) that since 


we have 


that is, cos 2 is within 2 of — 1. This implies that cos 2 < 0. Now since cos 0 = | and cos x is 
continuous on R, we conclude by the intermediate-value theorem that cos x = 0 for at least one x in (0, 
2). Let x, denote the smallest number in (0, 2) such that cos x, = 0. The existence of x, is guaranteed 
by the completeness of R and the continuity of cos x. (Verify!) 


Definition 68.8 We define 
1 = 2x, 


where x, is the smallest positive real number such that cos x, = 0. 
By this definition, cos (z/2) = 0, and since 


[cos (x/2)}* + [sin (2/2)? = 1, we conclude that sin (7/2) is 1 or —1. 


However, cos x > 0 in (0, 2/2); so equation (68.5) implies that sin x is strictly increasing in (0, 2/2); 
therefore, sin (z/2) = 1, since sin 0 = 0. Using Theorems 68.6 and 68.7, we find that cos z = cos (2/2 
+ 7/2) =— 1, and similarly sin z = 0, cos 27 = | and sin 2z = 0. Using these facts and Theorems 68.6 
and 68.7, we have 


cos(x + 2m) =cosx sin(x+2x)=sinx forallxeR (68.6) 


Bin(x) 


Figure 68.1 


and 


COs (« 


The graphs of sin x and cos x are sketched in Figure 68.1. 
We conclude this section with the definition of the other trigonometric functions. The formulas and 
interrelationships of these functions are left as exercises. (See Exercises 68.1 to 68.6.) 


I . . T 
+5) = —sinx sin (x +5) = COS X for allxeR 


2 


Definition 68.9 We define the following functions for each x ¢ R , where the expression makes sense 


fan x = cots t t 
~ COs x (tangent) 
Cates: COs X ta 
ae (cotangent) 
| 
sec x = —— (secant) 
COs xX 
1 
csc x = — (cosecant) 
sin xX 
Exercises 
68.1 Determine the domain and range of each of the functions in Definition 68.9. 


68.2 
68.3 
68.4 


Prove that (tan x)* + 1 = (sec x)’ and (cot x)? + 1 = (csc x)’. 
Find the derivative of each of the functions in Definition 68.9. 
Sketch the graph of each of the functions in Definition 68.9. 


68.5 Define appropriately restricted inverse functions for each of the trigonometric functions. 
68.6 Find the derivative of the functions defined in Exercise 68.5. 
68.7 Evaluate the following limit: 


tim sin x + cos x — e* 
x-0)60O Cop (i + x*) * 


68.8 ( Wallis’ Product) Let a, = §§!? sin'x dx, n= 2,3,.... 


(a) Prove that {a,} 1s decreasing. 


(b) Prove that 
1+3+5 vee (2n — 1) = 
Ga Ta gieetay | 
wx 2°4 +++ Gn — 2) 
and Mint PES Baas (2n — 1) 
(c) Prove that 
_2hs++ Qa) 1:3--- Ga — 1) & . 2:4°-- Oa 2) 
Seo GatD 2-4+++(2n) 2 7 3+5-++ (Qn —1) 


68.9 


and, hence, conclude that 


(Stirling's Formula) 
(a) Let a, = 1 and 5, = log k in the summation by parts formula (Theorem 28.1) to derive 


nt a—1 q 
2, log k =— 2, * log (i +7) +- n log n 
(b) Take three terms in the expansion for log (1 + x) (see Exercise 67.8) to derive 
1 1 1 CE 
log (1 +3) =a + 38 
where 0 < c, < 1. Combine the equations above to obtain 
2 log k = nloga — (x — 1) 


(c) Using the result of Exercise 67.7, which established the existence of the limit 
lim... (Dk=1 1/k — log n), prove that 


. 68.7 
lim (3; log k — wlogn —5logn + n) ( ) 
exists. 
(d) Prove that 
nie" 
tt 
exists. 
(e)* Let g, = nein" «/m. Prove that 
ae _ _2:4+++ (2n) 1 fee 1) 2 
@y, 1-3++- (Qn —1) f2n +1 ne | 


and deduce that 


. az = 
lim —+ = f2z 
neo “2n 


(f) Prove Stirling's formula: 


Stirling's formula states that n! is approximately y* /Jaje* in the sense that the ratio of these 
two terms approaches |. [The argument of (a) through (d) is due to Shohat (1933). ] 
68.10 (a) Derive the expansion 


o 


1" eek tl 
arctan x = 21 (— ) ska |x] <1 


(b) Deduce from (a) that 


68.11 Derive a power series expansion for arcsin x similar to that given in Exercise 68.10 for 
arctan x. 

68.12 Adapt the proof of Lemma 68.3 to prove that if f(x) = —cf(x) for some c > 0 on [0, z] and 
J(0) = f(z) = 0, then c = 1/n’ and f(x) = k sin nx for some constant k and some nonnegative 
integer n. 


Xll 


Inner Product Spaces and Fourier Series 


In many of the metric spaces we have studied it is possible to define addition and scalar 
multiplication in such a way that the spaces become vector spaces over the field of real numbers. 
(Appendix: Vector Spaces summarizes the definition of a vector space and some elementary results 
we will be using subsequently). For example, if we define addition and scalar multiplication 
pointwise in R’, /’, and gla, b], each of these sets becomes a vector space over R. Thus these spaces 
(and others) have a much richer structure than merely being equipped with a distance function. In R” it 
is possible to define the length or norm of a vector which corresponds to the geometric interpretation 
of length. It is possible to generalize the concept of the length of a vector to ? and gla, b] (and to 
other spaces as well). A vector space with a length function is called a normed linear space. The 
vector space R” has another important concept associated with it and that is the idea of 
perpendicularity or orthogonality of pairs of vectors in R". This concept also generalizes to and g 
[a, b]. A vector space with an orthogonality-measuring function is called an inner product space. In 
this chapter we will study inner product spaces and orthogonal expansion of vectors in inner product 
spaces with particular attention to gla, a+ 27], where ae R. 


69. Normed Linear Spaces 


If we define 


(x, .- aS) + (Ni-P) = OY + Vay see Xn t Yad 
5 Ee, OY GG fb me 
where (x,,...,%,); (Vp .-.,),)€R" and c € R, then R” becomes a real vector space. The zero vector of 
R’ is the n-tuple (0, 0,..., 0) and the additive inverse of (x,,...,,) 1S (-X,,..., —X,). It is easy to 


verify that the other vector space axioms are also satisfied. We shall always denote the zero vector of 
a vector space by @; this is to avoid confusion with the real number 0. 
In R” it is possible to define an “absolute-value-type” function. We let 


xl] = fat tee + oe (69.1) 
where x = (x,,...,%,)¢R". [fn = 1, py is precisely py, the absolute value of x. We call xy the norm of 


x. Geometrically, the norm of x is the length of the vector x. This norm function satisfies the following 
properties: 
(1) jx = 0 if and only ifx = é. 


(11) Cx] = [c] pq] for x e R’. 

(iii) x + y] spy + py for xy eR’. 

Properties (1) and (11) are easily verified. Property (111) follows from the triangle inequality for the 
metric space R". Indeed, if d denotes the usual metric for R" and x = (a, ...,%,),¥ = Oy. +5),) ER 
we have 


Ix + yl = JG, ty)? +--+ +P 


= d(x, —y) 

<= d(x, #) + dO, —y) 

as JfxF beet xe +f x + yi t+ 2 + - 
= lll + Wy 


The preceding discussion motivates the next definition. We remark at this point that all vector 
spaces in this text are over the field of real numbers. 


Definition 69.1 Let V be a vector space. A norm for V is a function j-| from V into [0, 0%) which 
satisfies the following: 

(i) py = O if and only if x = 6. 

(il) Joxy = cj pq for ce Rx e V. 

(ili) Jr + yy spy + py for xy € V. 

The ordered pair (V, |") (or more simply, V) is called a normed linear space (or normed vector 
space). 


Property (111) of Definition 69.1 is called the triangle inequality. 

We have already observed that equation (69.1) defines a norm on R”. To give further examples of 
normed linear spaces, we must first turn some of our familiar examples into vector spaces. 

If {a,} and {b,} are real sequences and c eR, we define 


{a,} + {4,} = {a, + 5,} cf{a,} = {ca,} (69.2) 


With these definitions of addition and scalar multiplication, /' and /? become vector spaces (verify). 

Let [a, b] be a closed interval and let gla, b] be the set of all bounded functions on [a, 5]. Under 
pointwise addition and scalar multiplication g[a, b] 1s a vector space (verify). The spaces Cla, 5] 
and gla, b], where « € Ba, b}, are subspaces of g[a, b] (verify). 


Theorem 69.2 
(1) The equation 


aly er eT ae | 
W(x, ---, XO = f/x? + z 


defines a norm on R”". 
(11) The equation 


Itextll =, la 


defines a norm on /'. 
(111) The equation 


adh =| y @ 


defines a norm on /’. 
(iv) The equation 


[fl] = lub {1f@)I : x € [a, 5]} 
defines a norm on g[a, b] and hence also on the subspaces C[a, b] and g[a, b], where « € Ba, 5} 
Proof. The proof of part (1) precedes Definition 69.1. The proofs of parts (11) and (111) are similar 
and thus are omitted. The proof of part (iv) is left as an exercise. gy 


The next theorem shows how it is possible to define a metric in a normed linear space. 
Theorem 69.3 If (V, jj) is a normed linear space, then the equation 
d(x, y) = |x — yl 


defines a metric on /. 

Proof. Let x,y « V. Then d(x, y) = 0 if and only if jx — yj = 0 which by Definition 69.1(1) holds if 
and only if x — y = @. Thus property (1) of Definition 35.1 holds for d. 

Let x,y e V. Then 


a(x, Y) = |x — yll = M—1)y — I = |-Allly — x] = lly — xi] = dy, x) 


and thus property (11) of Definition 35.1 holds for d. 
Finally, let x,y,z e V. Then 


a(x, z) = |x — zl 
= |x -y + O- 2) 
< |x — yl] + lly — all 
= d(x, y) + d(y, 2) 


and thus property (111) of Definition 35.1 holds for d. Therefore, dis a metric for V. 


Consider the normed linear space R", where the norm for R” is defined by equation (69.1). The 
metric of Theorem 69.3 derived from this norm is 


A[(X 1, - + Xa Vis ses Pad = WO - Mad — as ee + Pod 
= [1 — Var -- +> Xy — Yad 
= iC 4 ny? 7 eae (x, aad Vay? 


Thus the metric of Theorem 69.3 for R” is identical to the usual metric for R” (see Section 36). 
Similarly, it is easy to verify that the metric defined in Theorem 69.3 for /', ? or C[a, b] with the 
norm given in Theorem 69.2 is identical to the metric defined previously for each of these spaces. 

Whenever we apply any metric space definitions (such as continuity, limit of a sequence, open set, 
compact, complete, etc.) to a normed linear space V, unless otherwise specified, it will be assumed 
that the metric for V is that given in Theorem 69.3. For example, a sequence {x,} in a normed linear 
space V converges to x in V if for every e > 0, there exists a positive integer N such that ifn > N, we 
have 


|x, i x|l = a(Xqs x) <6é 


A complete normed linear space is called a Banach space. Thus each of the spaces R’”, /', /?, and 
C|a, b] are Banach spaces. (See Section 46 and Corollary 60.8.) 

Normed linear spaces will be considered in some detail in Chapter XIII. In the remainder of this 
chapter we will be concerned with a special kind of normed linear space known as an inner product 
space. 


Exercises 


69.1 Let S denote the set of all real sequences with addition and scalar multiplication defined by 
equation (69.2). 
(a) Prove that Sis a vector space. 
(b) Prove that each of the spaces /', /’, cy, and /” is a subspace of S. 
(c) Is H® a subspace of S? Justify your answer. 
69.2 (a) Prove that gla, b] is a vector space. 
(b) Prove that each of the spaces Cla, b], BV[a, b], and g,[a, b], where « € Bfa, 5}, are 
subspaces of gla, b]. 
69.3 Give the details of the proof of Theorem 69.2 (11) to (iv). 
69.4 Let V be a vector space and let d be a metric for V which satisfies 
(a) d(cx, cy) =|cd(x, y) for ce Rand x,y eV. 
(b) d(x, y) =d(x + z, y +z) for x,y,z eV. 
For x in V, define jj = d(x, 0). Prove that (V, ||) is a normed linear space. 
69.5 Let (V,, |-j,) and (V,, |-,) be normed linear spaces. 
(a) Prove that V, x V, is a normed linear space if we define addition and scalar 
multiplication by the equations 


(x1, Yi) + (2, Y2) = CX + X2, Vr + ¥2) e(x, y) = (cx, cy) 
and the norm by the equation 
[x, WI] = Ills + [Illa 


(b) Prove that if V, and V, are Banach spaces, then V, x V, is a Banach space. 
69.6 Let V be a normed linear space and let y e V and c € R. Prove that each of the following 


functions is continuous: 
fa=xty gX)=cx A= xx) = |[>]l 


69.7 Let V be the set of all real sequences {a,} such that for some positive integer N, a, = 0 for all 
n> N. 
(a) Prove that V is a vector space. 
(b) Prove that the equation }\;a,}|| = 72, Ja,| defines a norm on J. 
(c) Prove that V is not a Banach space. 
69.8° Prove that every normed linear space is connected. 
69.9 Prove that a normed linear space V is compact if and only if V= {6}. 
69.10 Prove that |jx,}|| = lub {|x,| |2¢P} defines a norm on /” and, therefore, also on cy. The metric of 
Exercise 35.6 is derived from this norm. 
69.11 (a) In analogy with Definition 46.6, define the completion of a normed linear space. 
(b)° Using your definition above, prove that every normed linear space V has a completion W 
such that 7 = W. 


70. The Inner Product Space R°’ 


In R° one encounters the inner product (or dot product) defined by the equation 


(X,Y) = XY, + XY, + UW, 


where x = (X,,X7,%3), V = (V1,V22¥3) € R®. The norm of a vector x in R? is related to the inner product by 
the equation 


xl] = /(, x) 


Among the properties of the inner product useful in computations (all of which are easily verified) 
are 

(i) (cx + y, z) =c(x, z) + (y, Z) for all ce Rand x,y,z eR’. 

(ii) (x, cy + z) =c(x, y) + (x, Z) for all ce Rand x,y,z € R’. 

(ili) (x, vy) =(y, x) for all x,y e R’. 

(iv) (x, x) = 0 ifand only ifx = 0. 

Properties (1) and (11) state that the inner product is linear in each coordinate. 

Ifx and y are unit vectors in R’, that is, if xj = 1 = jy, the inner product (x, y) has the geometric 
interpretation as cos g, where g is the angle between x and y (see Figure 70.1). The inner product 
gives a useful test for perpendicularity. The nonzero vectors x and y in R® are perpendicular if and 
only if cos g = 0, where ¢ 1s the angle between x and y. Thus unit vectors x and y are perpendicular if 
and only if (x, y) = 0. Arbitrary nonzero vectors x and y are perpendicular if and only if the 
associated unit vectors x/jxj and y/jyj are perpendicular. Thus nonzero vectors x and y are 
perpendicular if and only if (x/p, v/v) = 0. This equation holds (using the linearity of the inner 
product) if and only if (x, y) = 0. Thus nonzero vectors in R° are perpendicular if and only if (x, y) = 


0. If we adopt the standard assumption that any vector 1s perpendicular to the zero vector, we have the 
following theorem: vectors x and y are perpendicular in R° if and only if (x, y) = 0. We will use the 
term orthogonal interchangably with perpendicular. 


$ 


¥* Ys Voi ¥g! 


Figure 70.1 


Figure 70.2 


Many theorems from geometry may be proved using the inner product. We give a quick proof of the 
Pythagorean theorem. (See Figure 70.2.) 


Theorem 70.1 Ifx and y are orthogonal vectors in R’, then jx + yj? = py? + py. 


Proof. We compute using the linearity of the inner product and the fact that (x, y) = (y, x) = 0. 


Ix + pI? = + yx +) 
=(x+ y+ (x+y) 
=(%)+@Qy+090+0» 
= (x, x) + (, ) 
= [xi]? + ily? a 


Similar methods prove the generalized Pythagorean theorem. 
Theorem 70.2 Let {x, y, z} be a set of mutually orthogonal vectors in R*. Then 
Ix + y + zi? = Ix]? + byl? + Ilzl? 
Let x = (X,,%5,%3), V = 01.%,V3) € R®. The Cauchy-Schwarz inequality (Theorem 36.1) states that 
xi. + X2y2 + Xayal & Mx +d + BVH) + 93 + 5 


Using the inner product and norm notation, we may elegantly rewrite this inequality as (70.1) 


We conclude this brief section by consideritt SrlAd hal expansions in R’. We call a set {x,, x,, 
x;} of vectors in R’ an orthogonal set if each pair {x,, x,}, {x,, x3}, and {x,, x;} is orthogonal. We 
call an orthogonal set of unit vectors an orthonormal set. 

One of the standard orthonormal sets in R? is the set fj, j, &, 


where; =(1,0,0, jf=(,1,0, k=(,0,1) 
Any vector x = (c,,C,,C,) ¢ R® may be written as the unique linear combination 


x= C1 + ¢,j + cgk 
The coefficients are given by the equations 
(70.2) 
C=), c=(j), ¢3=(,%). (Verify) 
We will generalize this situation to arbitrary orthonormal sets in R°. We begin by showing that if a 
vector in R® has an orthonormal expansion, the coefficients are uniquely determined by equations like 
those in (70.2). 


Theorem 70.3 Let {x,, x,, x;} be an orthonormal set in R’ and let x ¢ R*, where 
aaa OP Oa ual 250, aa a 0, 


Then c,=(x,x,) fork=1,2 and 3 
Proof. fk = 1, 2, or 3, then 


(%, Ay) = (CX, + CoXq + CyXy, Xp) 


= €(%1, Xp) + C2(%2, HH) + C5(%3, H) = Cy a 
We next show that any vector x in R? has the orthonormal expansion 
X = (X,X,)x, + (X,x,)x, + (%,%5)%; 
where {x,, X,, x3} is an orthonormal set in R’. 


Theorem 70.4 Let {x,, x,, x,;} be an orthonormal set in R’. Then every vector x in R°® has the 
representation 


X= (XH), (7,2 )Xy + (55), 


Proof. We first show that the set {x,, x,, x,} 1s linearly independent in R’ and hence a basis for R’. 
Suppose we have scalars c,, c,, c, such that 


Cx, + CX, ag CX, = 0 


By Theorem 70.3, c, = (6, x,) =0 for k = 1, 2, 3, and hence {x,, x5, x3} is linearly independent in R’. 


Let x e R®. Since {x,, x5, x;} is a basis for R’, there exist scalars c,, c,, c, such that 
Y= CX PCA, Ce, 
By Theorem 70.3, c, = (x, x,) fork=1, 2,3. ™ 
The coefficients c, = (x, x,), k= 1, 2, 3, of Theorem 70.4 are called the Fourier coefficients of x 
relative to the orthonormal set {x,, x,, x;}. The sum 
(2,4), + (2,%,)X, + 1%5)>X3 
is called the Fourier series of x relative to {x,, x,,x,}. Theorem 70.4 states that the Fourier series of 


x 1S equal to x. 
Parseval's theorem states that the sum of the squares of the Fourier coefficients of x is equal to yyy’. 


Theorem 70.5 (Parseval's Theorem for R*) Let {x,, x,, x;} be an orthonormal set in R’ and let x « 
R’. Then 


3 
Ix? = ¥ x)? 
k=1 
Proof. By Theorem 70.4, 
3 
x= FY (x, xx 
k=] 
Since {(x, x,)x,, (x, X,)x,, (x, X;)x;} 1s a set of mutually orthogonal vectors, by Theorem 70.2 


3 2 3 
¥ (X, X,)Xql = = II€x, x,)% (7 
k=l k=l 


and the theorem follows immediately. m 
In the remainder of this chapter we will generalize the results of this section to other settings. 


71. Inner Product Spaces 


In this section we will define an abstract inner product space and give several important examples. 
Our definitions and results should be compared with those of Section 70 concerning R’. 


Definition 71.1 Let V be a vector space. An inner product (sometimes called a dot product or scalar 
product) for Vis a function (, ) from V x V into R which satisfies the following: 


(1) (cx + y, z) =c(x, z) + (, Z) for all ce Rand all x,y,z V. 
(11) (x, vy) =(y, x) for all x ve V. 

(111) (x, x) > 0 for all xe V. 

(iv) If (x, x) = 0, then x = 0. 


The ordered pair (V, (, )) (usually denoted by just V) 1s called an inner product space. 
We now give three important examples of inner product spaces. 


Theorem 71.2 
(1) The equation 


(x, y) a >: XV 
k=1 


where x = (x,,..., %)s¥ = Oy «++ >3_) €R" defines an inner product on R’. 
(11) The equation 


OY) = Li wade 


where x = {x,}, y = {y,} e/? defines an inner product on F. 
(111) The equation 


a= | fe 


where f, g € &[a, 6] defines an inner product on g[a, b] with the exception that property (iv) of 
Definition 71.1 is replaced by 
(iv)' If (f, f) = 0, then f= 0 almost everywhere in [a, 5]. 


Proof. Part (1) easily verified. 

The sum y@, , x,y, In part (ii) converges by Theorem 36.3. The fact that the equation in part (ii) 
defines an inner product on /’ is easily established. 

If £ ge Ala, db) then fg ¢ Afa, 6] by Theorem 51.13(iii) and thus f° fg is defined. It is easy to verify 
that properties (1), (11), and (111) of Definition 71.1 hold for g[a, b]. We verify (iv)’. 

Let fe gla, b] and suppose (f, f) = 0. Then j* 2 = 9; so by Corollary 58.6, / = 0 almost everywhere 
in [a, b]. Therefore, f= 0 almost everywhere in [a, 5]. (Note that 0 in g[a, b] 1s A(x) = 0 for all x efa, 
b).) m 


If n = 3, the equation in Theorem 71.2(i) defines the usual inner product for R° (see Section 70). 
The space Cla, b] is a subspace of gla, b] so the equation in Theorem 71.2(ii1) also defines an inner 
product on C[a, b]. However, (iv)' for Cla, b] 1s equivalent to Definition 71.1(iv) for if a continuous 
function is zero almost everywhere in [a, 5], it is identically zero in [a, b] (verify). The inner product 
space gla, b| will be examined in some detail in Sections 72 to 76. 

We next state an elementary theorem which will be useful in our subsequent computations. 


Theorem 71.3 Let V be an inner product space. Then 
(i) (x, cy +z) =c(x, y) + (x, z) force R, and x,y,z eV. 
(11) (cx + dy, cx + dy) = c?(x, x) + 2cd(x, y) + @(y, y) for ode Rand x,ye V. 


Let V be an inner product space. If we set 


Ix] =/G,x) forxeV 


it is easy to verify that 

(i) jp = 0 if and only ifx = 6. 

(ii) Jcx] = || pq] for all ce Rand xe V. 

In order to prove the triangle inequality, we need to prove the Cauchy-Schwarz inequality for 
arbitrary inner product spaces. The proof of Theorem 71.4 should be compared with the proof of 
Theorem 36.1 (which is the special case V = R"). 


Theorem 71.4 (Cauchy-Schwarz Inequality for Inner Product Spaces) Let V be an inner product 
space and let 


Ix] =/(x,x) forxeV 


Then (x, ~)1 < Ixy] for allxpe V 


Proof. If y = 6, the conclusion is obvious; so we suppose y # @. Then (y, y) > 0. If c is any real 
number, then 


O < (x — ey,x — cy) = (x) — 2c(x, y) + c7(v, ¥) 
Letting c = (x, y)/(y, y), we have 


tor > Gea 
(yy) OY 


0 < (x, x)-—2 


which reduces to 


(x, y)* 


PS OD 


and the inequality now follows. m 
Corollary 71.5 Let V be an inner product space. The equation 


[x|] = ./(x, x) xeV 


defines a norm on /. 


Proof. Properties (1) and (11) of Definition 69.1 are easily verified. 
Let x,y e V. Then 


lx+ vP = @+yx4+VN=%2)4+%AxWY+HKy) 
< [lx]? + lilly + byl? 
= (Ix + |yl))* 


where we have used the Cauchy-Schwarz inequality (Theorem 71.4). Therefore property (111) of 
Definition 69.1 also holds. m 


If V is either of R” or , Corollary 71.5 defines a norm identical to the norm on R" or 7 defined 
previously in Theorem 69.2. The Cauchy-Schwarz inequalities previously given for R” and / 
(Theorems 36.1 and 36.6) are identical to the Cauchy-Schwarz inequalities of Theorem 71.4 for V = 
R’ or V =P (verify). 

The norm defined by Corollary 71.5 for gla, b] is given by the equation 


fll = J (7 for fe #fa, b) 


This norm is called the L?-norm for g[a, b]. The distance between two functions fand g in g[a, b] is 
given by the equation 


a 
df,9) = If - al = JI Uo 
The Cauchy-Schwarz inequality for g[a, b] becomes 


6 6 
{4 </| Pap ao for all fig < Aa, 5] 


The subspace C[a, b] of gla, b] is now equipped with two norms, the Z?-norm and the uniform 
norm. The Z?-norm on C[a, b] is given by the equation 


fle = AiG 


and the uniform norm on C[a, b] is given by 


fll, = lub {1 f(x] | x € [a, 5} 


These norms are not the same (see Exercise 71.8). 

A complete inner product space is called a Hilbert space, and thus R’ and /’ furnish examples of 
Hilbert spaces. It can be shown that the space gla, b] is not complete in the metric from the L*-norm, 
and therefore g[a, b] is an inner product space which is not a Hilbert space. The accompanying chart 
shows the interrelationships of the various spaces we have defined. 


Hilbert space 
i \ 
inner product space Banach space 
N i 


normed linear space 


metric space 


Exercises 


71.1. Prove Theorem 71.2(1) and (11). 

71.2 Prove that properties (1), (11), and (111) of Definition 71.1 hold for the inner product of 
Theorem 71.2(111). 

71.3. Prove Theorem 71.3. 

71.4 Prove that properties (1) and (11) of Definition 69.1 hold for the norm of Corollary 71.5. 

71.5 (a) Prove that equality holds in the Cauchy-Schwarz inequality (Theorem 71.4) if and only if 
there exist scalars c and d such that cx = dy. 
(b) When does equality hold in Corollary 71.5? 

71.6 Let V be the vector space of Exercise 69.7. 

(a) Prove that the equation 


(x,y) = Ex 


defines an inner product on /. 
(b) Prove that V is an inner product space which is not a Hilbert space. 
71.7 (a) Let V be an inner product space. Prove the polarization identity 


Ix + yl]? — |lx — »]/? = 4, ») for allx,vyeV 


and the parallelogram law 


[Le + yl? + |e — vll? = 2(I xl? + [lvl] for all x, ye V 


Interpret the last equation geometrically in the plane. 

(b) Show that the parallelogram law is not satisfied in any of the spaces /', /”, cy, or C[a, b] 
(where C/a, b] is given the uniform norm). Deduce that there is no inner product which gives 
the norm for any of these spaces. 

(c) Let V be a normed linear space in which the parallelogram law holds. Define (x, y) by 
the polarization identity. Prove that (V, (, )) is an inner product space and that |||) = y@,x)- 

71.8 Define fe C[0,1] by f(x) =x. Calculate yfj,, and j/j,. 
71.9 Prove that gla, b] is complete in the metric of the uniform norm. 
71.10 (a) In analogy with Definition 46.6, define the completion of an inner product space. 

(b) Using your definition above, prove that every inner product space V has a completion W 
such that 7 = W. 


72. Orthogonal Sets in Inner Product Spaces 


We begin by defining orthogonality in abstract inner product spaces in terms of the inner product. (See 
Section 70 for motivation.) 


Definition 72.1 Let V be an inner product space. We say that vectors x and y in V are orthogonal (or 
perpendicular) if (x, vy) =0. A set_X of vectors in V 1s said to be an orthogonal set if any two distinct 
vectors in X are orthogonal. A set X of vectors in V is said to be an orthonormal set if X is an 


orthogonal set for which jj = 1 for every x & X. 


Examples of orthonormal sets are provided by the next theorem. 


Theorem 72.2 
(1) The set 


{0} 0} 6:05: D (0.10) < 0.2) sang Ol O)vcs AD) 


is an orthonormal set in R”. 
(ii) The set ¢g™}= | is an orthonormal set in /°, where 


= ] ifn=m 
Om? am 


0 ifnem 
(111) Let 
] COS nx sin Hx 
Pox) = Jan’ Pan—1(X) = va P(X) = ie 
forxe Randn=1,2,.... Then {@, g,, .. .} 18 an orthonormal set in gla, a + 27] for any 


real number a. 
Proof. Parts (1) and (11) are easily verified. 
We first verify part (111) for the special case a = 0. Now 


Idol? = [ (rz) aA 


Ibo? = 2" cos? nx Fig BET sin nx cos mx|?" , 
ane 0 in = 2nn i 
2 
Paull” = 1 


Similarly, [$a_ll? = 1 


Finally, we must show that any two distinct vectors in the set {@, 9,,...} are orthogonal. Now 


2" cos nx sin nx|2* 
($0; Pan—1) = |, Jon ax = n Jarl = 
(Po, b2,) = 0 


Similarly, (o, $2,) = 0 
Ifn =m, 


2" cos mx sin mx 


Ce 


_ 1 {cos 2nx eed 0 
~ On 2n 0 ai 


dx 


Ifn#m, 


2% cos nx sin mx 


(Pan-11 Pam) = \. nt 


ell = [Gn + )x] _ cos [(m — al" iii 
2n m+n m—n ) 
Similarly, one shows that ifn # m, 
(Pon-11 Pam-1) = 9 = (Pan Gam) 
Therefore, the set {@, g,, . . .} 18 an orthonormal set in [0, 27]. Since all of the integrands appearing 


in our proof are periodic of period 27, the values of the integrals are not altered by changing the 
limits of integration from J%* to se+2=, (We will give a formal proof of this fact in the next section.) 


Thus {@, 9, ..-} 1S an orthonormal set in gla, a+ 27]. m 


We will call the set {@, g,, . . .} of Theorem 72.2(i11), the trigonometric set. We will study the 
inner product space gla, a + 27] and the trigonometric set in great detail in the remainder of this 
chapter. 


Exercises 
72.1 Prove Theorem 72.2(1) and (11). 
72.2 Let {@, 9,,...} be the trigonometric set. 
(a) Prove that j@,,)| = 1. 


(b) Prove that (9, 9,,,) = 0. 
(c) Prove the integration formula 


{cos ax sin bx dx = pote __ cos ee — 


a 


for alla#b,a#-b 
used in the proof of Theorem 72.2. 
(d) Complete the proof of Theorem 72.2 by showing that ifn # m, 


(dan—1; P2m—1) =0= (bans dam) 


72.3 Let X be an orthogonal set of nonzero vectors in an inner product space V. Prove that the set 


xe x} 


NEI 

||] 
s an orthonormal set in V. 

72.4 Let Xbe an orthogonal set of nonzero vectors in an inner product space V. Prove that X is a 


linearly independent set of vectors in V. 
72.5 (Gram-Schmidt orthogonalization process) Let V be an inner product space. Let {x,, x,, 


...} be a linearly independent set of vectors in V. Let y, =x, and 


— yy Om Id - 
Yu = Xm 2, val y,  form=2,3,... 


Prove that {y,, y>,...} 1s an orthogonal set in V. Interpret this process geometrically in R’. 


WG: VAX = 1168 5305). 
(a) Prove that_X is a linearly independent set in the vector space g[-—1, 1]. 
(b) Let {wo, w,,-.-} be the orthogonal set obtained from_X by the Gram-Schmidt 


orthogonalization process (see Exercise 72.5) for the inner product space g[—1, 1]. Compute 


Yoo Wis Wa. ¥3- 


Let 
fil) = (x? — 1)" 


forxe« Randn=0,1,2,....Let 


Be) = 5 FOC) 


for x «[—1,1] andn=0, 1, 2,.... The polynomial @, is called the Legendre polynomial of 


order n. 
(c) Compute 4, 0,, 8,, 8, and compare your results with part (a). 


(d) Prove 


One s(x) = xO(x) + ( + 18,0) for xER 
(e) Prove 
(rt + 1)O ne s(x) = Ct + 1)x8,(x) + (? — AiG) = forxeR 
(f) Prove 
[C1 — x? )On On) — Onl OKC = [rere 1) — a(n +1] O00) 
forxeR 
(g) Prove that the set {), 0,, . . .} 1s orthogonal in g[—l, 1]. 
o> Fy g 
...,¢, such that 


(h) Let n be a nonnegative integer. Prove that there exist constants c,, c,, 


Ox = Di CeWe 
k=0 


(i)° Prove that there exist constants k,, k,,...suchthat0,=kw,,n=0,1,.... 


73. Periodic Functions 


In this section we will first justify changing the limits of integration in the integral of a periodic 
function (Theorem 73.2). This fact was used in the proof of Theorem 72.2(iii). We will then briefly 
examine the problem of extending a given function to a periodic function. 


Definition 73.1 Let fbe a function on R. We say that fis periodic of period p > 0 if 
fxt+p)=fx)  forallxinR 


Theorem 73.2 Let f be periodic of period p and suppose that fe gla,a + p]. Ifc e R, then fe g[c,c + 
p| and 


Proof. Let n be an integer and let g(t) = t — np. Then g 1s a strictly increasing function from [a + 
np, a+ (n+ 1)p] onto [a, a + p]; so by Theorem 56.3, (fo g)g' ¢ Bla + np, a + (n + 1)p]. However, 


[Fe ga") = f@ — mp) = 


and thus fe @fa + np, a + (n + 1)p] for every integer n. It follows that fis Riemann integrable on every 
closed subinterval of R (why?). 
We conclude the proof by showing that ifc e R, 


We first evaluate 


[70 ax 


P 


Letting g(t) =t + p and using Theorem 56.3, we have 


ct ce ¢ 
['peyax = [f+ nat = |" pear 
P 20 0 
Therefore [r= [s a: [r= ['4+|f- \\F E 
c c P ¢ 0 0 
We now consider the problem of extending a function fon [a, a + p| to R so that fis periodic of 
period p. Incase f(a) = f(a + p), we may simply extend fby the rule 


T(x) = f(* — np) a+npsxx<a+(n+t+ lp 


where n is an integer. (See Figure 73.1.) 
Suppose fe gla,a + p]. Define g by the rule 


f@ x=at+p (73.1) 


Figure 73.1 


Then g(x) = f(x) for x e [a,a + p); so 


[ef 


Since g(a) = g(a + p), g may be extended to R so that g is periodic of period p. Therefore, 


\."¢ - "9 = me (3 


for any c in R. Thus g serves as a kind of periodic extension of f, and so far as the integral is 
concerned [equation (73.2)], nothing 1s lost by redefining fat x =a + p. 

Finally, let fe Cla,a + p]. If f(a) =f(a + p), we may extend f to a continuous function on R periodic 
of period p. If f(a) # f(a + p), we may replace fby g [equation (73.1)] and extend g to a function on R 
periodic of period p. Equation (73.2) is still valid. However, we have introduced discontinuities. The 
extension g is discontinuous atx =a + np,n=0, +1, +2,....(See Figure 73.2.) 

We will let CP[a, 5] denote the set of functions continuous on R and periodic of period b — a. Our 
above discussion shows that CP[a, b] can be identified with the set of continuous functions fon [a, 5] 
satisfying f(a) = f(b). The set CP[a, b] plays an important role in the theory of the inner product space 
ala, b]. (See Section 77.) 


Exercises 


73.1 Give an example of periodic functions f and g such that f+ g 1s not periodic. 

73.2 Prove that CP[a, b] is a vector space under pointwise addition and scalar multiplication. 

73.3 A bounded, continuous, real-valued function on R is said to be almost periodic if for every € 
> 0, there exists Z > 0 such that in every interval of 


g-extended 


a-p 8 a+p a+#2p 


Figure 73.2 


length L there exists a point a for which f(a + t) — f(t)\<e for every te R. 

(a) Prove that any continuous periodic function is almost periodic. 

(b) Prove that an almost periodic function is uniformly continuous on R. 

(c) Prove that if fand g are almost periodic functions, then f + g is almost periodic. 
(Compare with Exercise 73.1). 


74. Fourier Series: Definitions and Examples 


We begin by extending Theorem 70.3 (which is concerned with R*) to an arbitrary inner product 
space. The proof of Theorem 74.1 is identical to the proof of Theorem 70.3. 


Theorem 74.1 Let {x,,...,.x,} be an orthonormal set in an inner product space V and let x e V. 
Suppose there exist scalars c,,..., c, such that 


n 
xm > cyr, 
Ket 


Then c,=(xx,) fork=1,....n 


Proof. 


(x, X) = (3, CjX js *,) - Y CA Xj Xp) = Cy a 


j=1 


Theorem 74.1 states that 1f a vector x in an inner product space V is a linear combination of the 
members of an orthonormal set {x,,...,x,}, then x is the unique linear combination 


t 
+= 2, (% Xp )Xy 


Let {x,, x5, ...} be a countable orthonormal set in an inner product space V and let x e V. 
Motivated by Theorem 74.1, we can form the infinite series 


Y (x, xm 
n=] 
and ask when 
x= - (x, %,)%, 
m=1 


This is one of the central topics studied in the theory of Fourier series. 


Definition 74.2 Let X = {x,, x,, . . .} be a countable orthonormal set in an inner product space V and 
let x « V. The infinite series 


: (x, Xy Xn 
n=1 
is called the Fourier series of x (relative to X). The coefficient (x, x,) is called the nth Fourier 


coefficient of x (relative to X). 
The Fourier series of a function fin g[a, a + 27] relative to the trigonometric set is 


} ipe¥*" ie) 2 fcosnx (** cos nt 
LG bb) = Vin = |. Vin" +3 Un i f(t) Va 


sin 7X 


P| ro SF a)| 


If we let 


the Fourier series of freduces to 


+ x G, Cos mx + 5, sin nx) 


As an example, we calculate the Fourier series of f(x) =x, -m<x <7. 
We have 


] 54 
=; | tcosntdt = 0 n=6,1,... 


i ; 2(-—1)"*! 


t sin nt dt = ———— ¥ nem 1, By. si 


and thus the Fourier series of fis 


2 2-1)"*} 
_—_ 


n=1 


sin nx 


Let {x,,x,,...} be an orthonormal set in an inner product space V and let x « V. If we ask whether 
the Fourier series of x converges to x, we are asking whether the series 


oF (x, XX y 

n=1 
converges to x. In an arbitrary inner product space, the norm is given by |» = /@,)), ye Y, and thus 
we are asking if the sequence of partial sums of the series y~, (x, x,)x, Converges to x in the inner 
product space norm. Therefore, the Fourier series of x converges to x in the inner product space norm 
if for every e > 0, there exists a positive integer N such that if k = N, we have 


x — y (x, Xi)% 


sad (74.1) 


In the inner product space gla, a + 27] convergence of the Fourier series of a function fe gla, a + 
27] to fin the inner product space norm means for every e > 0, there exists a positive integer N such 


that if k > N, 


We have called such convergence L*-convergence. We will show (Theorem 78.5) that the Fourier 
series of a function fe gla, a + 27] converges to fin the L?-sense. 

The sequence of partial sums of the Fourier series of a function fe gla, a + 27] is a sequence of 
real-valued functions. Thus we can also pose the questions: (1) Does the Fourier series of f converge 
pointwise? (2) Does the Fourier series of f converge uniformly? 

Question (1) is very difficult. It has been known for some time that continuity of f at x does not 
imply convergence of the Fourier series of f at x. (See Hewitt and Stromberg, 1965.) It has recently 
been shown that if fe gla, a + 27], then the Fourier series of f converges almost everywhere to /. 
(See Carleson, 1966.) We will show (Corollary 76.8) that if fis differentiable at x, then the Fourier 
series of f converges to fat x. 

Concerning question (2), we will prove (Theorem 77.5) that if fe CP[a, a + 27], then the Fourier 
series of f is uniformly Cesaro summable to f and that if fe CPfa,a + 2x] n BV[a,a + 2x], then the 
Fourier series of f converges uniformly to f(Theorem 79.3). 


Exercises 


74.1. What is the Fourier series of an element of R” or /? relative to the orthonormal sets defined in 
Theorem 72.2? 
74.2 Let {x,,x,,...} be an orthonormal set in an inner product space V and let x,y e V. Let n=, a,x, 


and 2. ¢,x, be the Fourier series of x and y, respectively. Prove that >=, (c, + d,)x, 1S the 
Fourier series of x + y. 
74.3 Compute the Fourier series of the following functions: 
(a) f(x) =x 0 <x < 2a 
(b) f(x) =X -tWex<t 
(c) f(x) =x° Osx <2 
QDra={, T8232 


—z<ox=< 90 
x O<x<a 
©m=, “Serco 


HAY) =p-msx<2 
Which of the above functions belong to CP[0, 27] or CP[-z, z]? 


74.4 (a) Suppose that fe g[—z, a] and f(x) = f(—x) for x e [0, z]. Prove that the Fourier series for f 
1S ao/2 + UZ, a, cos nx, Where a, = (2/n) J% f(t) cos nt dt- 
(b) Suppose that fe g[—-z, 2] and f(x) = —(-x) for x € [0, z). Prove that the Fourier series for 
fis yz, b, Sin nx, where 6, = (2/n) fz f(t) Sin nt dt. 
Let fe g[0, z]. Define F(x) = f(-x) for x e [-2,0) and F(x) = f(x) for x e [0, z]. Define G(x) 
= —f(-x) for x e [-7,0) and G(x) = f(x) for x e [0, z]. By (a) the Fourier series for F' is 
ao/2 + D831 a, COS NX, Where a, = (2/n) Jzf(t) Cos nt dt, and by (b) the Fourier series for G is 
re, b, Sinnx, where 6, = (2/x) fz f(r) sin nt dt. 
We call these series the Fourier cosine and Fourier sine series (respectively) for f on [0, 
7]. 
74.5 The temperature v(x, f), at location x and time ¢, of a rod of length z whose ends are kept at 
temperature zero is described by the boundary value problem: 
(i) PG . , Poo) Om x<a,t>d 
(11) V(0, t) =0 = v(z, t) t= 0 
(iu1) v(x, 0) =f(x) Osx<a 
where f(x) 1s the initial temperature distribution. (See Figure 74.1.) 


0° x o° 
0 r 


io=-_p 


temperature v(x,t) at time t 
temperature f{x) at time O 
Figure 74.1 


(a) Show that if v,(x, t) and v,(x, t) satisfy (1) and (11) so does c,v, + c,v,, where c,,c, € R. 
(b) Assuming that (1) has a solution of the form v(x, t) = X(x)7(t), prove that 


Xx) _ T(r) 
Xtx) T(t) 


and that, therefore, each side of this equation defines a constant function. Thus, we must have 
(iv) X"(x) = cX(x) and T(t) = ckT(t). 
(c) Show that if_X and 7 satisfy (iv), then v(x, t) = X(x)7(2) satisfies (1) and that if further 
X(0) = 0 = X(z), v(x, £) satisfies (11) also. 
(d)° Show that any nontrivial solution of the system_X’(x) = cX(x), T(t) = ckT(t), X(0) = 0 = 
X(z) is X(x) =k, sin nx and T(r) = k,e7*** for some positive integer n and for constants k, and 
a 
By (a) the sum of solutions is a solution. Therefore, guided by (d), we try for a solution of the 
form 
(V) oe, 1) = 3) Cyens sin nx 


In order to satisfy condition (111), we must have 
f(x) = v(x, 0) = x C, sin ax 


But this equation tells us that C,, should be the nth Fourier coefficient of the Fourier sine series of f- 
(See Exercise 74.4.) Moreover, if fis a reasonable function, the Fourier series of f will converge 
to f so that condition (111) is satisfied. (Differentiability of f suffices by Corollary 76.8.) Under 
appropriate conditions series (v) converges and may be differentiated term by term so that 
conditions (1) and (11) are also satisfied. (See Rabenstein, 1972.) 


75. Orthonormal Expansions in Inner Product Spaces 


In this section we will extend several of the theorems of Section 70 (concerning R°*) to arbitrary inner 
product spaces. Our first goal is to extend Theorem 70.3 to the corresponding statement about a 
countable orthonormal set {x,, x,,...}. If we could replace n by © in the proof of Theorem 74.1, we 
would have a valid proof. Thus what we are demanding is that 


(= Vis 2) —_ >, (Ys z) 
k=1 k=1 
or equivalently, 


(im ¥ ve 2) = lim } (2) 
mok=1 


nog kel 


As usual, to justify the interchange of limit, we must establish continuity (in this case, of the inner 
product). 


Theorem 75.1 Let V be an inner product space and let z e V. The function f defined by the equation 


Ax) = (2) 


is continuous on V. 


Proof. Ifz = @, fis constant and hence continuous. Thus suppose z # 0. Let e > 0. Let 5 = e/jzj. If x 
— yj < 6, then 


| f(x) ~ SON = IC, z) = (y, z)| 
= |(*— », 2)| 
< |x — ylllzll < dz] =« 


where we have used the Cauchy-Schwarz inequality. Therefore, fis continuous. m 


Corollary 75.2 Let V be an inner product space and let z e V. Suppose that the series »%, y, 
converges to y in V. Then 


(¥, 2) -(x Vue z) = - (Yn 2) 


Proof. We are given that the sequence {s,},s, =y, ++ °° ty, converges to y in V. By Theorem 
40.2, since f(x) = (x, z) is continuous, 
es (s,) = f(y) 
lim f(s,) = lim (x Ver 2) = lim 53 (ps Z) 
mo \kKel nrc k=t 


Now "* _ 
= Da (Vie Zz) 
On the other hand, 


fo) =((ya)= (x ¥ 2) 


k=1 
and the conclusion follows. ™ 


We are now ready to prove the analogue of Theorems 70.3 and 74.1. 


Theorem 75.3 Let {x,, x,, . . .} be an orthonormal set in an inner product space V and let x e V. 
Suppose 


forc,¢ Randn=1,2,....Then 
c, = (x%,x,) n=1,2,... 


Proof. Using Corollary 75.2, we have 


« es 
(x, xy) = (s CjX js *,) = 7 CAX jy X,) = C, 
Y j= 


jal 


forn=1,2,...._ 


Theorem 75.3 states that if we wish to have x = ¥%., ¢,x,,, we must take c, to be the nth Fourier 


coefficient of x. 
Let {x,, x5, ...} be an orthonormal set in an inner product space V and let x e« V. We derive a 


lemma from which we prove that the best approximation to x using a linear combination of the form 
Co oes 


is achieved by taking c, to be the Ath Fourier coefficient of x. In view of Theorem 75.3 this is not too 
surprising. 
Lemma 75.4 Let {x,,...,x,} be an orthonormal set in an inner product space V and let x e V. Let c,, 
...,¢, ben scalars and set 
y= ¥ Om 
k=1 


u 


Then x — yl? = bel? — YG ad? + 2 IG x0 - oP 
k= = 
Proof. The proof is a straightforward computation. 
lx = yl? = (x == y) — (x x) al 2(x, y) fs (y, ) 
= ||x|? — 2x 5 oxi) + (x Cpr he » oy) 
k=l k=1 j=1 
= Wi? — 2 as) + ¥ a(a 3 oy) 
k=1 k=1 j=i1 
= |x]? -2¥ ox x) + ¥ |x Ci(Xps x] 
k=1 k=l =1 
= |x? -2) o@,x) + ¥ e 
k=1 kel 


= II? — 3 Gg? + 3 [Gnd - a? ce 


Theorem 75.5 Let {x,, x,, . ..} be an orthonormal set in an inner product space V and let x e V. Let c,, 
...,¢, ben scalars and set 


Vn = ¥ OLX, 2, = 2 (x, Xi) Xp 


Then = |x — z,[] < Ix — yall 


Proof. Taking c, = (x, x,),k=1,...,, 1n Lemma 75.4, we have 


n 
lle — zl]? = [x]? — Dy (x, x4)" 


Also by Lemma 75.4, we have 
lx — yl? = Ix? — Y Gea + Yad - a? 


and since }"_, [(x, x,} — ¢,]? = 0 the inequality follows. ™ 


We next prove a weakened generalization of Parseval‘s theorem (Theorem 70.5) known as 
Bessel’s inequality. We will again use Lemma 75.4. 


Theorem 75.6 (Bessel's Inequality) Let {x,, x,, ...} be an orthonormal set in an inner product space 
V and let x e V. Then the series y* , (x, x,)? converges and 


LG xy < Ix? 
Proof. Taking c, = (x, x,) in Lemma 75.4, we have 
|xI? — Gag? = bx — yP > 0 
Therefore for every positive integer n, 
YL @av? < bee 


and the conclusions now follow. m 


Theorem 75.6 for the special case V = gla, a + 27] states that if fe gla, a + 27] and 
? + i (a, cos mx + 6, sin nx) 
n=1 


is the Fourier series for f, then 


(75.1) 


(75.2) 


(see Section 72). We will later show [Corollary 78.6(11)] that equality holds in equation (75.1), and 
hence (75.2) will become 


which reduces to 


Corollary 75.7 Let {x,, x,,...} be an orthonormal set in an inner product space V and let x « V. Then 


lim (x, x,) = 0 


Proof. The proof follows immediately from Theorems 75.6 and 22.3. m 


The special case of Corollary 75.7 for V = gla, a + 2z] is important enough to isolate as a 
theorem. 


Theorem 75.8 (Riemann-Lebesgue Lemma) Let fe gla, a + 27]. Then 


at2n at2n 
lim | f() sin nt dt = 0 = lim | F(t) cos nit dt 


ro co & n~@ a 


We now give a condition which will allow us to deduce Parseval's theorem as well as several 
other interesting consequences. 


Definition 75.9 Let X = {x,, x,, . . .} be an orthonormal set in an inner product space V. If 
x= 3 (2, %,)%, 
nm=1 


for every x in V (convergence is relative to the inner product space norm), the orthonormal set X is 
said to be complete. 

A word of caution is in order at this point. Complete orthonormal set is a different concept than 
complete metric space. 

It is easily verified that the orthonormal sets defined in Theorem 72.2 for R” and are complete in 
those spaces. We will show later (Theorem 78.5) that the trigonometric set is complete in gla, a + 
27\, 


Theorem 75.10 Let X= {x,, x,, ...} be a complete orthonormal set in an inner product space V. Then 
() @&y) = Dik & xy. x) forall xye V. 
(11) (Parseval's theorem) jx? = y2, (x, x,)* for all xe V. 
(111) Ifa vector x in Vis orthogonal to x, for every positive integer n, then x = 0. 
(iv) Ifx¢x, the set x U {x} 1s not orthonormal (that is, X is a maximal orthonormal set). 
Proof. Let x,y « V. Then 


x= ‘? (x, t%, y= 2, (y, XX 
n= 


n=) 


Using Theorem 75.2, we have 


G9 =(¥ Gade FOr xl) 
Y ,39( 5 Osean) 


- p> 
z Os x0[ FO. dt x4) 
=, 


es xs x) 


Part (11) follows from part (1) by taking x = y. 
If (x, x,)=0,n=1,2,..., by part (11), 


I|x||? = 2, (x, x,)? = 0 
Finally, suppose x ¢ x and ¥ u {x} 1s an orthonormal set. Then (x, x,) =0,n = 1, 2,..., and by part 
(111), x = 0, which is impossible. gy 


Exercises 


75.1 Prove the generalized Pythagorean theorem. If {x,,...,x,} 18 a set of mutually orthogonal 
vectors in an inner product space V, then 


n r 
= 2 
2, xe? = 3 lll 


75.2 Verify inequality (75.1). 

75.3. Find a necessary and sufficient condition for equality in Theorem 75.5. 

75.4 Deduce the Cauchy-Schwarz inequality (Theorem 71.4) from Bessel's inequality (Theorem 
75.6). 

75.5 Prove that an orthonormal set containing 7 elements is complete in R”. Can you generalize to 
lial 

75.6 Let X= {x,,x,,...} be an orthonormal set in a Hilbert space V. Suppose that X is a maximal 
orthonormal set (that is, if x ¢ x, then X U {x} is not orthonormal). Prove that _X is a complete 
orthonormal set. This exercise together with the proof of Theorem 75.10 shows that ina 
Hilbert space, properties (1) to (iv) of Theorem 75.10 are equivalent to XY being a complete 
orthonormal set. 

75.7 Prove the following generalization of Bessel's inequality. Let {x,, x, ...} be a sequence in 
an inner product space V. (This sequence is not assumed to be orthonormal.) Let x « V Then 


N NV 
XI, xa)? < [fl]? max 2) [Gin md 
h=L1 1212N m=1 


75.8 Let V be a Hilbert space and let Wbe a dense subspace. Prove that if X= {x,,x,,...} isa 
complete orthonormal set in W, then_X is also a complete orthonormal set in V. 


76. Pointwise Convergence of Fourier Series in gla, a + 27| 


In this section we begin specializing the general theory of Fourier series to the inner product space g 
[a, a + 27] by considering the problem of when the Fourier series of a function f in gla, a + 27] 
converges pointwise to f. We will prove (Corollary 76.8) that a sufficient condition for convergence 
is that fbe differentiable. 

To show that the Fourier series of a function fin g[a, a + 27] converges at x, we must show that the 
limit of the nth partial sum of the Fourier series of fat x, s (x) exists. We begin by deriving an integral 
representation for s,(x). Now 


sition x i ft) dt + = 2, E kx i ft) cos kt dt 


a+ 2 
+ sin kx | F(t) sin nt a | 


a+ 20 


a+2n n 
= = | f(t) dt + 3, | f(#)[cos kx cos kt 


a a 


+ sin kx sin kt] dt 


atanZ c) ae+2n 
=x | A) at | f(t) cos [k(x — t)] dt 


a slJa 


Suppose that f(a) = f(a + 27), so that we can extend f to a periodic function on R of period 2z. [If 
f(a) # f(a + 27), we may redefine f at a + 27 so that f(a) = f(a + 27). This does not affect the Fourier 
series of f- See Section 73.] Making the change of variable u = x — t (Theorem 56.3), our formula 
becomes 


s(x) = Bs T(x — u) du + : f(x — u) cos ku du 
2n *x—(at+2n) Nx 


=1 Jx—(at+2n) 

= ("fe —t)dt+ 72 ic — t) cos kt dt 

since [x — a] — [x — (a + 22)] = 2a (Theorem 73.2). Thus if we let 
Dt) = : + ps cos kt 

we have the elegant integral representation 


s(2) = = |" fx — )D,(t) de 


for s (x). Thus the problem of convergence of {s,(x)} involves the study of the functions D_. 


Definition 76.1 The Dirichlet kernel D, is defined by the equations 


1 | x 
Dot) = 3 D,{t) = = Py coski forn=1,2,... 


We summarize the discussion preceding Definition 76.1 in the following theorem. 


Theorem 76.2 Let f be periodic of period 27 on R and suppose fe gla, a + 2]. Lets, be the nth 
partial sum of the Fourier series of f. Then 


l T 
s,(2) = =i fix — )D,(t) dt 


Proof. The proof precedes Definition 76.1. m 


In order to study the functions D,,, it is convenient to derive a more explicit formula for D,. We do 
this in the next theorem. 


Theorem 76.3 
. sin [(n + 4)¢] 
©) DO =F sin @Day_ 


for all 7 e R with sin (¢/2) #0. 
(ii) =|" Dude = 1 
Proof. We use the identity 
sin (u + v) — sin{u — v) = Zsinvcosu 


Taking u = kt and v = ¢/2, we have 


sin (é + 5)t|- sin | (& ~1+ 5) | = 2sin (5) cos kt 


We compute the telescoping sum 


= > {si IC + 3) | cilia ( —s 3) 


and equation (1) now follows. 
Equation (11) follows immediately from the definition of D,. ™ 


Let f be periodic of period 2z and suppose fe gla, a + 2a]. The Fourier series of f at x will 
converge if 


lim s,(x) = lim . [ f(x — t)D,(t) dt (76.1) 


no 


exists. The Riemann localization theorem (Theorem 76.4) shows that in any case if 0 < 5 < 2, 


—} tt 
lim i T(x -— t)D,(t) dt + | Sx — t)D,{t) at| = 0 
ns co oon 6 
Thus the limit in equation (76.1) will exist if and only if 


lim =i f(x — t)D,{t) dt (76.2) 


B+ 00 -6 
exists for some 5, 0 < 5 < a. If either of the limits in (76.1) or (76.2) exists, then the other does also 
and they are equal. 

In (76.2), the variable ¢ satisfies —s5 < t < 5, so that u = x — t¢ satisfies x — s <u <x + g. Thus the 
behavior of the integral in (76.2) and hence also in (76.1) depends only on values of fin a small open 
interval containing x. This is the reason for the name /ocalization theorem. In summary, convergence 
of the Fourier series of fat x depends on the behavior of fin a neighborhood of x. This fact should be 
contrasted with the situation for power series (see Theorem 27.2). 


Theorem 76.4 (Riemann Localization Theorem) Let g ¢ g[—2, z]| and let 5 satisfy 0 < 5 < z. Then 


lim |. g(t)D,(t) dt + [; a@,@) at | = 0 
nooo —" 6 


Proof. Let 
0 —d<t<6 
j= 
‘ai te d<|t|<x 
0 -d<t<6 
g2(t) -| 
g{t) cot (t/2) ds lt) sa 


Then g,,2, € g[—2, a] and by Theorem 75.8, 


lim | g,(t) cos nt dt = 0 = lim [" g2(t) sin nt dt (76.3) 


roo 


By Theorem 76.3(1), if§ << 7, 


sin [( + 4)r] 


DA) = sin (2) 


Thus 


(J+ Paonia 


7 (|. $ Po) 
] 
2 


: 2 sin (#/2) 


6 t t 

= ({ a | Jatey(cot§ sin nt + cos nt dt 
t r] 

= 5 | g(t) sin nt dt + | g,(t) cos at a | 


and the theorem now follows from equation (76.3). ™ 


a 
n 


We are now ina position to prove that differentiability of fat x implies that the Fourier series of / 
converges to f at x. Actually we will prove that a slightly weaker condition known as the Lipschitz 
condition suffices. 


Definition 76.5 A function fis said to satisfy a Lipschitz condition at x 1f for some M > 0 and 5 > 0, 
Lf) — FO) <= Mx — 9 
whenever ft — <6. 
Theorem 76.6 If fis differentiable at x, f satisfies a Lipschitz condition at x. 
Proof. Suppose 


tf) — FH) fe = f'(x) 
1 a 
Taking e = 1, there exists 5 > 0 such that if 0 <j — 3 <4, then 


FQ) — fe) x 


z= —f'@) <! 


Thus ify — 4. <6, 


If) — fs + LOODIy - > 


Theorem 76.7 Let f be periodic of period 2z and suppose fe gla, a + 27]. If f satisfies a Lipschitz 
condition at x, then the Fourier series of f converges to fat x. 


Proof. By Theorem 76.2, it suffices to prove that 


lim : [ fx — 2)D,(t) dt = fe) 


n> a 


By Theorem 76.3(11) 


1 z 
fix) = = [" 1692, dt 
and hence we must show that 


lim = {" Lf — 9) - OID dt = 0 


nero 


Let «> 0. Since 


2 sin (t/2 


1 
1+0 t 


there exist constants & and 5,, 0 < 5, <7, such that 


<k  forall0 <|z| <4, 


t 
2 sin (t/2) 
Thus for any positive integer n, if 0 <j4{<5,, we have 


samy {(n + 5)¢] 


2D,(t)] = 


Ift = 0, tD,(t) = 0, so that 
[t(D] < k for all |f| <= 6, and # a positive integer 
There exists 5, > 0 and M > 0 such that 
4) —/O) = MIx— yl for |x — p| s 0, 


Let 5 = min {§,, §,, e/(4Mk)}. Then for any positive integer n, 


[Lee = 9) — eo, a 


3 
< [Lele = 8) — OIIDACOL a 
ce { M|t\|[|D,(2)| dt 

—6 

. é 
< | Mk dt = 2Mké < = 

- 2 

-é ft 

let i= [ [f(x — t) — COD, ()) at + i [fx — 1) — fOQ1D, (4) dt 
By Theorem 76.4, there exists a positive integer N such that 


fA <5 for alln = N 


Thus, ifn > N, 


i __U& - 9 - FOP a : 
= 


[ro = 9 - foun a + lhl <8 


Corollary 76.8 Let fbe periodic of period 27 and suppose fe gla, a + 27]. If fis differentiable at x, 
then the Fourier series of f converges to fat x. 


Proof. The result follows from Theorems 76.6 and 76.7. m 


If fe gla, a + 2z], and fis differentiable at a point x in the open interval (a, a + 27), then the 
Fourier series of f converges to fat x. For we may alter f at a + 27 so that f may be extended to a 
periodic function on R of period 2z without altering either the Fourier series of f or the value of f at 
x 
Example. Let 


P x —N<X<T 
f) = 
0 CS =—TOrK— 2 


Then f is differentiable in (—z, z); so by Corollary 76.8, 
= 2 tig: 
x= } =(-1)"*' sin ax, —R<XSN 
n=1 ft 


If we take x = z/2, this reduces to 


We have previously derived this formula by another method. (See Exercise 68.10.) 
Exercises 


76.1 Investigate the pointwise convergence of the Fourier series of Exercise 74.3. 


76.2 Prove that if f satisfies a Lipschitz condition at x, then fis continuous at x. Give an example to 
show that the converse of this statement is false. 


76.3 Prove that if fis left and right differentiable at x, then f satisfies a Lipschitz condition at x. 
76.4 Derive a formula for D (¢) in case sin (¢/2) = 0. 


76.5 Let fbe periodic of period 27 on R and suppose fe gla, a + 27]. Lets, be the nth partial sum 
of the Fourier series of f. Derive the integral representation 


SAX) = jo ean pie ee D,(2t) dt 


76.6 Prove Theorem 76.3(i) by induction. 
76.7 Prove that the series 72. , (cos kt/k) converges pointwise except when ¢ is a multiple of 27. 


When is convergence uniform? 


77. Ces,sro Summability of Fourier Series 


We remarked earlier, that it is known that the Fourier series of a continuous function may diverge at 
some points. Fejgr showed how this difficulty could be surmounted if instead of considering the 
sequence {s,} of partial sums of the Fourier series one instead considers the sequence {a,} 


g ae ee medio 
a 2 


of Cesgro sums. Fejgr proved that if fe CPla, a + 27], then {¢,} converges uniformly to f. In this 
section we will prove Fejgr's theorem (Theorem 77.5) and derive several consequences. 
We begin by deriving an integral representation of ¢,. This development parallels that for s, of 


Section 76. 
Let f be periodic of period 2z and suppose fe gla, a + 2z]. Then 


ip 


i = : ic — t)D,{t) dt 


. ¥. D,(t) 
= - [- fx- AP la 


n+i1 


1 


Thus if we set K,(t} = [I/(@# + I] Xfeo Dy(t) We have the integral representation 
axe) = =|" fle = NK AO at 
Definition 77.1 The Fejgr kernel K, is defined by the equation 
Kt) = ae D,{t) for allteRandrz=0,1,... 


Theorem 77.2 Let fbe periodic of period 27 and suppose fe gla, a + 27]. Let {s,} be the sequence 
of partial sums of the Fourier series of f and set 


Then o,@) == ("fee - OKC di 
We next find a convenient formula for the Fejgr kernel. 


Theorem 77.3 


1 sin [(# + 1)t/2J]? 
K,(t) = 2(n + 5 | 


for all ¢ with sin (¢/2) #0. 
Proof. By Theorem 76.3(1), 


1 n 
Kt) = oS | pm Dt) 
1 » sin [(K + 4)¢] 
n+ 2sin (#2) 


1 Be 1 ma 
= 3m ¥ 1) sin2(¢/2) pa 51m | + se | sin > for all ¢ 


with sin (¢/2) # 0. 
We use the identity 


cos (« — v) — cos(u + v) = 2sinusine 
Taking 4 = (k + 4)t and v = ¢/2 and v = ¢/2, we have 


coskt —.cos[(kK+1)t]_.. 1 : 
5 = sin | (é + 5)«| sin 5 


We compute the telescoping sum 


1 — cos [(# + jt] 
2 


cos kt — cos [(k + 1)z] 
2 


- Smell db] 


By the half-angle formula 


£— Ore i 2) sin?| = 05 | 


and the formula for K, follows. m 
We will make use of the following facts about K, in proving Fejgr's theorem. 


Theorem 77.4 
(1) K,(¢) = 0 for all ¢ 


(i1) - a K,{t) dt = 1 


1 
(1) KO < yaa 


Proof. (1) follows from Theorem 77.3. 
(11) follows from Theorem 76.3(i1) and Definition 77.1. 


for0<g<fs7 


If0 <5 <j<7, then sin’(s/2) < sin’(¢/2), and (iii) now follows from Theorem 77.3. 


Theorem 77.5 (Fejgr) Let fe CPla, a + 27]. Let {s,} be the sequence of partial sums of the Fourier 
series of f. Let 


Then {o,} converges uniformly to fon R. 


Proof. Let « > 0. Choose M such that \(x)| < M for all x e R. Since fis uniformly continuous, there 
exists 5 with z > 5 > 0 such that 


If) -fON<Z for |x-y1 <8 


By Theorem 77.4(i1i), there exists a positive integer N such that ifn > N and 5 <|q4<7, 


tr 
Kt) = jem 


By Theorems 77.2 and 77.4(i1), 


as) — f0) = 5" fee— OK ae— 3 |" PEDRO at 
=; [Ure - 9 - feoK,(0 a 


1 z 
Thus Jo,0) — fa) <5 [Lf - 1) ~ FOOIK Ao at 
where we have used Theorem 77.4(1). 
Ifwq<g, then(x-)-xA<5 


ae Lf(x — t) — fCO|Kt) dt < re a0 K,(t) dt 


+ 


SO ef 
< ra Al?) dt 


where we have used Theorem 77. 4(i) and (11). 
Ifn > Nand 5 <j <7, then 


& 
K,(t) s Ter 


SO AI. + | \ine- 9 = f0IK Oat = Gee | 2M a= G 


oe 


Thus ifn > Nandx eR, 


lo,(x) — f(x)| aoe = 5 < én 


Corollary 77.6 (Uniqueness of Fourier Series in CP[a, a + 27]) Let fg e CPla, a+ 27]. If f and g 
have the same Fourier series, then f(x) = g(x) for every x in R. 


Proof. Let {a,} be the sequence of Cesaro sums of the Fourier series of fand g. By Theorem 77.5, 
{o,} converges uniformly to fand g and thus f(x) = g(x) for every x in R. m 


Corollary 77.7 The trigonometric set is complete in CP[a, a + 27]. 


Proof. Let fe CP[a, a + 27]. Let {s,} be the sequence of partial sums of the Fourier series of f and 
let {c,,} be the sequence of Cesgro sums. 
Let > 0. By Theorem 77.5, there exists a positive integer N such that ifn > N, then 


| f(x) — a,(x)| < St for all x € [a, a + 27] 


Thus ifn > N, 


a+ 21 


If- onl? = [. u- H's an3 


It follows from the definition of ¢, that ¢, is a linear combination of @,, ... 
g.,. By Theorem 75.5, ifn > N, 


If— si? < If - oI? <5 <6 m 
Corollary 77.8 Let CP[a, a + 27]. Suppose 
ao ma * 
3 + oy (a, cos nx + 5, sin nx) 
is the Fourier series of f and 
3 + }° (c,cosmx + d, sin nx) 
n=] 
is the Fourier series of g. Then 
P i) at+2n 
(i) B+ Sata + xd) == | Sa 
n=l ® Ja 
ae 2 wo 427 
(ji) 2+ FS @+twa-tl 'p 
n=1 z a 


ar2 
a 


sec 5 at 20 
(iit) If | f(x) cos nx dx = 0 = { f(x) sin nx dx 


forn=0,1,2,..., then f(x) =0 for every x eR. 
(iv) Ifh e CP[a, a + 27] and h¢ {6 , 4, .. .} then {h, gp, 9, . . .} is not orthonormal in CP[a, a + 
27]. 


Proof. The proof follows immediately from Theorems 77.7 and 75.10. m 


Example. Let f(x) = pq for -7 <x <a. Then fis in CP[-a, z]. The Fourier series of fis easily shown 
to be 


a 


5+ Py a Ea cos [(2n — 1)x] 


By Corollary 77.8(11), 


This equation reduces to 


am ] at 
2, G1 7% 


Corollary 77.9 (Weierstrass Approximation Theorem, Special Case) Let f be continuous on [—z/2, 
m/2|. Lete > 0. There exists a polynomial p such that 


| f(x) — p(x)| < ¢ for all xe E 4 
Proof. Extend f as a continuous function on R periodic of period 2z. One possible extension of f is 
sketched in Figure 77.1. Lete > 0. Let {¢,' be the sequence of Cesgro sums of the Fourier series of f- 


By Theorem 77.5, {o,,} converges uniformly to f on [—7/2, 2/2]. Thus there exists a positive integer N, 
such that 


loy,x) — f@)| < 5 for all xe Ee 4 


Since ey, is a linear combination of 


{sin nx, cosmx|n =0,1,..., M} 
a for N, even 
where If xx 
N,-1 
= for NV, odd 


it follows that oy, has a power series representation 
oy (x) = ¥ a,x" 
n=0 


valid for all x in R. By Theorem 63.1(i), 5%, a,x" converges uniformly to ox, on [—2/2, 2/2]. Thus 
there exists a positive integer N such that 


N 
Oy, (x) — 2. a,x") < 5s for all xe E 4 


Figure 77.1 


If we let px) = ¥%., a,x", then 
[pPx) — FO) = |p) — on.) + lon.) — FO) < 
for all x e€[—x/2, /2]- 


Corollary 77.10 (Weierstrass Approximation Theorem) Let f be continuous on [a, 5] and let « > 0. 
Then there exists a polynomial p such that 


|f(x) — p@)| < 
for all x in[a, 5]. 


Proof. Let g be the “change of scale” function defined by the equation 


b-—a T 
g(x) = b+ = ( -5) 


The graph of g is sketched in Figure 77.2. Then g is a one-to-one continuous function from [—2/2, 2/2] 
onto [a, b] with a continuous inverse. Since h =f , g is a continuous function on [—7/2, 2/2], by 
Corollary 77.9, ife > 0 there exists a polynomial g such that 


A(x) — g@)]<e forall xe EE 4 
Let x € [a,b]. Then g~*(x) ¢ [—x/2, 2/2], and hence 
|h(g~*(x)) — a(g7*(X))| <8 
Sinceh , g'=(f. g). g =f, we have 
If) — eg) <e for all x [a, 5] 


Therefore, if we letp =q . g ', p Satisfies the conclusion of the corollary. 


Example 77.11 We will describe a sequence of infinitely differentiable 


Figure 77.2 


functions {p,} on [a, b] which converges uniformly on [a, b] to a continuous nowhere differentiable 


function. 
Let f be a continuous nowhere differentiable function on [a, 6]. By Corollary 77.10, for every 


positive integer n, there exists a polynomial p, such that 
\p,.(x) — f(x) < - for all x € [a, b] 


It follows that {p,} converges uniformly to fon [a, b]. Since a polynomial is infinitely differentiable, 
we have the desired example. 


Exercises 
77.1 Prove Theorem 77.3 by induction. 
77.2 Apply Corollary 77.8(ii) to the functions f(x) = x’ and g(x) = pq on [—z, z]. 
77.3 Letfbe continuous on [a, 5]. Suppose that 


i f(x)x"dx = 0 


forn=0, 1,2,.... Prove that f(x) = 0 for all x € [a, 6). 

77.4 Where does the proof of Theorem 77.5 break down if K, is replaced by D,,? 

77.5 Letfbe periodic of period 2z and suppose fe aa, a + 2x}. Leto, be defined as in Theorem 
77.2. Derive the integral representation 

on(x) = ‘ [ *£@ + 24) + fe — 2) K,(2t) dt 

77.6 Letfbe periodic of period 2z and suppose fe afa, a + 2x}. Let x be a point in [a, a + 27] for 
which 

lim (24 OtIG—O Ly 


r+ 0+ 


exists. Prove that the Fourier series of fat x 1s Cesgro summable to Z. Deduce that if fis 


continuous at x, then the Fourier series of f at x 1s Cesaro summable to f(x). 
77.7 Prove that C[a, b] in the uniform norm is separable, that is, that there exists a countable 
subset _X of Cla, b] such that ¥ = C[a, b]. 


78. Fourier Series in gla, a + 27| 


In this section we will extend certain of the results of the previous section to the inner product space 
gla, a + 2a]. Such generalizations are possible because any function in gla, a + 27] is L?- 
approximable by a function in CP[a, a + 22] (Theorem 78.4). The main result of this section is 
Theorem 78.5 which states that the trigonometric set is complete in g[a, a + 27]. 


Definition 78.1 Let [a, b] be a closed interval. A step function f on [a, b] is a function on [a, 5] 
which is constant on each open subinterval (x,_,,x,),i=1,...,n of some partition {x,, x,,...,x,} of 
[a, b]. 

A step function 1s pictured in Figure 78.1. 

Throughout this section the norm on g[a, b] is the Z?-norm, 


If =/[r 


We begin by showing that any function in g[a, b] is L? approximable by a step function. 
Lemma 78.2 Let fe &[a, 5}. If_ > 0, there exists a step function g on [a, b] such that 
If-gl<e 


Proof. Choose M such that jf(x)| < M for all x in [a, b]. Let e > 0. By definition, there exists a 
partition 


ee be eee | 


of [a, b] such that 


b 2 
| f- LEP) < 359 


Let g(x) - FOlnasisxg Tx. <% <3, 
I(x) if x = x; 


Then g is a step function on [a, b]; jg(x)j < M for all x fa, 6) and 


uf?) =| 9 


Now fu-o=[s-[o-[s-uin<ay 


Figure 78.1 


so that 
f Ga =| = 40% 
- [fu- g) + | o = 
b ° by 
< { fllf — al + | igllg - f' 
=[incr- 0+ | iar-o 


b 2 
<i | (f- 9) < 2M z= 0 


and hence jf — gj <ce. m 
Lemma 78.3 Let g be a step function on [a, b] and let e > 0. Then there exists 4 ¢ CP{a, 6] such that 
lg — Al <e 


Proof. Let « > 0. First suppose that the partition associated with g is {a, b}. Then g(x) = M, a < x 
< b. Choose K such that |g(x)| < K, x [a, b]. Let 


0 x=aorx=b5 


A(x) = a a? 2 


Extend / linearly to [a, b] (see Figure 78.2). 
Now g(x) — A(x) < g(x) + (x) = K + Wy < 2K, for all x fa, 6] so [g(x) — A(x)]? < 4K’, for all 
x €[a, 6]. Therefore, 


A = e7(32K) 


Figure 78.2 


b= ¢2/32K2 


and hence |g — hj < ¢/2 <e. 

Now let g be an arbitrary step function on [a, b] and let P = {x), x,,...,x,} be the partition 
associated with g. By the first part of our proof, for each positive integer 7, | <i <n, there exists a 
continuous function h, on [x,_,, x,] such that h(x,_,) =0 =h(x,) and 


xe ‘ 2 
| GH hy <5 


Let h(x) = h(x), for all x_, <x <x, i= 1,..., an. Then A is continuous on [a, b] and since 


h(a) = 0 = h(b), he CP[a, b]. Now 


b nt xe 2 
| o-w= Ff Gh)? <n— =e 


i= 

and thus jg — A <e. m 

Theorem 78.4 Let fe &fa, 6} and let -« > 0. Then there exists 4 ¢ CPfa, 6] such that 
If- All <e 


Proof. By Lemma 78.2 there exists a step function g on [a, b] such that 
If-al <5 
By Lemma 78.3, there exists 4 € CPf{a, 6] such that 
lg - Al <5 
Therefore |f— hl < If-gl + lg-Al<5+5=2m 


We can now generalize Corollary 77.7 to gla, a+ 27]. 


Theorem 78.5 The trigonometric set is complete in gla, a + 27]. 


Proof. Let fe ga, a + 2x] and let {s,} be the sequence of partial sums of the Fourier series of (| Let « 
> 0. By Theorem 78.4 there exists h ¢ CP[a, a + 27] such that 


é 
If-Al <5 


Let {t,} be the sequence of partial sums of the Fourier series of h. By Corollary 77.7, lim,_,,, j2 — ¢, 
= (). Thus there exists a positive integer N such that if n > N, 


€ 
Ik — Gl <5 


By Theorem 75.5, 
If - Sall Ss If - tll 


Thus ifn > N, 


If- sl <f- Gl sIf- Al + la-4l<54+5-em 


Corollary 78.6 Let g ¢ Ala, a + 2x]. Suppose 
= + x (a, cos ux + b, sin nx) 
n=1 


is the Fourier series of f and 


Co 


at >" (c, cos nx + d, sin nx) 
n=1 


is the Fourier series of g. Then 
. cs) 1 +2n 
(1) SO + Y (ayey + bad) = a) fa 
2 n=1 u a 


(11) (Parseval's theorem) 
az a _ 1 atk2n 
f+ S@+mH=-5( 7 
(iii) If 


at2z 


a+2x 
| f(x) cosnx dx =0= | f(x) sin nx dx forn = 0,1,2,... 


then f= 0 almost everywhere in [a, a+ 27]. 


Proof. The proof follows immediately from Theorems 78.5 and 75.10. my 
The uniqueness of Fourier series follows almost immediately from Corollary 78.6(111). 


Corollary 78.7 Let g ¢ Afa,a + 2x]. If f and g have the same Fourier series, then f = g almost 
everywhere in [a, a + 27]. 


Proof. If f and g have the same Fourier series, then 


| f(x) cos nx dx = | g(x) cos nx dx 


'b 
and | f(x) sin nx dx = [. g(x) sin nx dx 


forn=0,1,2,.... 
Thus 


i Lf(x) — g(x)] cos ax dx = 0 = i [f(x) — g(x)] sin nx dx 


forn=0,1,.... By Corollary 77.8(i11), f-— g = 0 almost everywhere in[a, a+ 27]. m 
Since the values of the integrals 


1 fe 1 fe 
; | F(x) cos nx dx, | F(x) sin nx dx 


are not changed by altering f at a single point, it is clear that we cannot conclude f = g everywhere in 
[a, b]. 


Example. Let f(x) =x, —az <x <a. The Fourier series of fis 


S x1? 


sin nx 


By Corollary 78.6(11), 
This equation reduces to 


This example suggests the following method for summing an infinite series »*, @, whose terms are 
nonnegative. Find a function fe @[a, a + 2x}, Such that (/, ¢,,) = /a, and (f, g,) = 0 otherwise. Then by 
Corollary 78.6, 


["se= E Got = Fo 


Our example shows that it is possible to find such a function f for the series 7, 1/n?. 

Unfortunately, there are series for which no such function in gla, a + 27] exists which will sum the 
series. This difficulty can be overcome if we extend the class gla, b] to the Lebesgue integrable 
functions on [a, b] to the extent that if y=, a2 converges, there exists a Lebesgue integrable function / 


such that (f, g,,) =a, (see Theorem 91.9). 


We conclude this section by proving a theorem about Fourier series analogous to Theorem 
63.1(ii1)equation for power series. Our theorem states that whether or not the Fourier series of / 
converges, the Fourier series may be integrated term by term with the correct result. 


Theorem 78.8 Let fe aa, a + 2x). Let 


a = : 
a + > (a, cos nx + 5, sin nx) 
n=1 


be the Fourier series of f. Ifa <c <a+t 2z, then the series 


(4 72 dt 4 7 | (a, cos nt + b, sin nt) dt 


nel Jc 
converges uniformly to f* fon [a, a + 2x] on[a, a + 27]. 


Proof. Let {s,} be the sequence of partial sums of the Fourier series of f. We must show that 


converges uniformly to fzfon [a,a + 2x}. This is equivalent to showing that {f*(s, — f)} converges 
uniformly to zero on [a, a + 27]. 
Let e> 0. By Theorem 78.5, there exists a positive integer N such that ifn > N, 
Is - fl < 5 


If x €[a, a + 2nj and n > N, then 


(fe 


< [[ie-ol | 


= |ls,— fil /2x <e 
where we have used the Cauchy-Schwarz inequality. my 


Example. The Fourier series for f(x) =x for-aw<x <7 is 


_ 


pi cies sin nx 
By Theorem 78.8, 


[tar = x —T [. sin nt dt for -nzn<x< n( 78.1) 


and convergence is uniform on [—z, z]. 
It is easily verified that 


© 9f—jytt a o 91)? es} 
¥ | sinntdt= > om cosmx—- 2) Z 


n=] n=l n=17 


Using the fact that s* | 1/n? = n?/6, equation (78.1) becomes 


y = cosmx for —n < x < n(78.2) 


2 

T 
v= = + 
3 1 on 


By Theorem 75.3, equation (78.2) gives the Fourier series for g(x) = x* on [—, z]. Thus by Corollary 
78.6(i1) 


This equation reduces to 


Exercises 
78.1 Let fe #a, 6} and let e> 0. Prove that there exists a polynomial p such that 
lIlf—apll<e 
78.2 Let recfa, ajand let ¢ > 0. Prove that there exists a step function g on [a, b] such that 
lg(x) —f(x)|< « forall xe [a, 5] 
78.3 Let fe Ba, 5}. Suppose that 


f- fox" dx = 0 


forn=0,1,2,.... Prove that f= 0 almost everywhere in [a, 5]. 
78.4 Apply Corollary 78.6(11) to the functions of Exercise 74.3. 
78.5 Prove the following expansions: 
(a) Sax —-F 42 x cose for allO <x <2z 
a=1 
(b) x-§-2 ee forallo<x<-x forall0<x<z 


(C) xsinx = I — Fcosx —2 5 x ee forall —x<x<z for all “Hex 


When is es uniform? 


78.6 Prove that 5 1. E 
78.7 (a) Prove that for no positive integer m is it true that 


ipa 
i? Le 
3/5, 


1 


(b) State and prove a generalization for the series 72, (1/n*), where k is an odd positive 
integer. 
78.8 Let fe #[a, a + 2x}. Let 


2 + z (a, cos ax + 6, sin nx) 


be the Fourier series of f. Let ¢e[a, a + 2x). 
(a)’ Prove that the series y=. , [(,/n) cos ne ~ (a_/n) sin nce] converges absolutely. 
(b) Let 


= Qn 
= ey (2s cos ne — sin nc) 


and g(x) = | £-¥ —K forall xefa, 6] 
Prove that 


649, Ft (Gn ny — On 
ns po (é sin nx — =" cos nx) 
is the Fourier series of g and that the Fourier series of g converges uniformly to g on [a, a + 


27]. 
(c) Prove that 


On 


#22 2 a ol ee 5 
a, Peet ae 
78.9 Compare the properties of Fourier series and power series. 
78.10 Is it possible to sum the series ¥2., (1/n%) by the methods of this section? 


79. A Tauberian Theorem and an Application to Fourier Series 


Fejgr's theorem (Theorem 77.5) states that the Fourier series of a function f in CP[a, a + 27] is 
uniformly Cesyro summable to f Thus a Tauberian theorem of the form, “If yr , ¢, is uniformly Cesyro 
summable to f and a Tauberian condition is satisfied, then y* , ¢, converges uniformly to f,”’ will have 
an application to Fourier series. The Tauberian condition is that {nf,} is uniformly bounded. The 
theorem is due to G. H. Hardy. 


Theorem 79.1 (Hardy) If y* , f, is uniformly Cesyro summable to fon a set X and if the sequence 
{nf,} 1s uniformly bounded on_X, then y=, £, converges uniformly to f on X. 


Proof. There exists a number M such that if,(x)|< M for every positive integer n and for every x in 
x. 


Let 
3) = ¥ fe 
k=1 


and let ¢,(x) = + 5 (x) 
kml 
for x in_X. Then ifm > n, we have 
(m — n)s,(x) — (m — n) f(x) = mfo,,4) — fQ)] — nfe,(4) — f@)) 


+ x (kK —1—n)f,x) (verify) 
k=nt+2 


79.1) 


Let e > 0. Choose e > 0 such that 
et<1 and e* + 2/e* + 2M./é* < ¢ 


Since {¢,} converges uniformly to f on_X, there exists a positive integer N’ such that ifn > N’, we 
have jo,(x) —f(x)j<e for every x in X. Ifm > n= N’, we have, by (79.1), 
m nr 
Sy) — f(x)| Ss m=- 7 Imi*) — f(x)| - m=— 5 ent) — f(x) 


l ht 
hg FO 1 MAO 


+ 


Fit i Pt at ol 
geen il ry imma 1-n)z 
m+n, M 2-1 
= é =— 

—n m—-nn jf 

_ mtn, M (m —n— 1)\(m — 7) 

ae nim — n) 2 

git e 5 u(™ : *) (79.2) 

m—n n 


26* m ; 
pa poet Lal eee SiS aon 
=a Gain ip u(? ) 


for every x 1X. 
Choose a positive integer N > max {6/,/é*, (1 + 2./é*)N*} and suppose that m > N. Now 


m m 
1 + 2,/6* ial Je (79.3) 


Since e <1, it follows that) + 3e® + 2" < 6, and therefore 


oF {pe 7 {pe 
Faas m _ m,/@ EE N,jé a (79.4) 
l+/je* 1+2/e* 14 3y fe® 4 2a 7 “6 6 


Inequalities (79.3) and (79.4) imply that there exists a positive integer n satisfying 


Tea <"<T5 gat79-5) 


ge a 
1+ dje* ~ 1+ 2/fe 1+ je 


and thus (79.2) holds. Therefore 
()- fool <et + u(™ 7 1(79.6) 
for every x in_X. Inequality (79.5) may be rewritten 
= HH = 
i+ Je? < a 1+ 2/8" 
l 


(min — 1) 
Therefore, if m = N we have combining inequalities (79.6) and (79.7) 


_ 1 
and thus - —1<2/e* and < s3¢(79.7) 
Vv 


\S,.(x) — f(x)| < 6* + det + M2 /e* 


for every x inX. q 

For ordinary infinite series, Hardy‘s theorem takes the following form: If y=, a, is Cesgro 
summable to L and {na,} is bounded, then y=, a, converges to L. Hardy conjectured, but was unable 
to prove, that ify2, a, is Abel summable to L and {na,} is bounded, then y=, a4, converges to L. This 
much deeper result was first proved by Hardy’s colleague, Littlewood. Littlewood‘s theorem was a 
significant generalization of Tauber’s original theorem (Theorem 65.3) for the Tauberian condition 
lim, ,,, va, = 0 of Theorem 65.3 implies that {na,‘ is bounded. Littlewood‘s theorem also generalizes 
Hardy’s theorem since, as we have pointed out before, Cesgro summability implies Abel summability. 
(See Hardy, 1949.) 

Hardy‘s theorem has a nice application to Fourier series since, as we will show, the terms of the 
Fourier series of a function of bounded variation satisfy Hardy’s Tauberian condition. 


Theorem 79.2 Let fe BV[a, a + 2x]. Then the terms of the Fourier series of fare uniformly bounded on 
R. 


Proof. First suppose that fis increasing on [a, a + 27]. Let 
a + x (a, sin nx + b, cos nx) 


be the Fourier series of f/ Then 


"7 li y i il cos nx 
na, = a) F(x) sin nx dx = a= i T(x) a(S") 
at+2z 


=- -| £0) cos RX 


a 


ack 21 
- | cos nx df | 


where we have used Theorems 55.7 and 53.3. Therefore, 
nay) < 5| Lfla + 2m) + 14a + |" Joos nx dr) 
Fife + ami + fal + [are | 
= <I1fla + 2n)| + [fla] + fla + 2n) — fla) 


The same inequality holds with a, replaced by 5,, and thus the theorem is established in case f is 
increasing on [a, a + 27]. The general case follows from Theorem 54.9. m 

We may combine Fejgr's theorem (Theorem 77.5) and the results of this section in the following 
theorem. 


Theorem 79.3 If fe CP[a, a + 2x] 0 BV[a, a + 2x], then the Fourier series of f converges uniformly to / 
onR. 


Proof. By Theorem 77.5, the Fourier series of f is uniformly Cesgro summable to f on R. By 
Theorem 79.2, the terms of the Fourier series of f satisfy Hardy's Tauberian condition. By Theorem 
79.1, the Fourier series of f converges uniformly to fon R. m 


Exercises 


79.1 Complete the proof of Theorem 79.2. 
79.2 Prove the following result. Let fe BY[a, a + 2a]. Let x be a point in (a, a + 27) such that 
Hin LAE Fo = 4) 


tor 2 


exists. Prove that the Fourier series of fat x converges to L. Deduce that the Fourier series of 
a function f of bounded variation on [a, a + 27] converges to f pointwise on [a, a + 27] except 
possibly on a countable set. 


XIII 


Normed Linear Spaces and the Riesz Representation Theorem 


In this chapter we will present a brief introduction to functional analysis and then prove the Riesz 
representation theorem (Theorem 84.1), which states that if 7 is a continuous linear transformation 
(see Appendix: Vector Spaces) from Cla, b] into R, then there exists we BY{a, 4] such that 
T(f) = [2 f de for all feC[a,b]. 


80. Normed Linear Spaces and Continuous Linear Transformations 


Functional analysis can be described as the study of normed linear spaces (and other more general 
vector spaces) in terms of the continuous linear transformations on these spaces. 

We recall (see Section 69) that a normed linear space is a (real) vector space V together with a 
norm ||- | on V.The metric on a normed linear space is given by 


d(x, y) = x = il X,YE as 


and metric space concepts applied to V are relative to this metric. 

When dealing with several normed linear spaces and when there is no possibility of confusion, we 
follow the usual practice of using the same notation ||- to denote any of the norms under 
consideration. For example, in Theorem 80.1, 7 is a linear transformation from V into W, where V 
and W are normed linear spaces. In part (iv) of this theorem we find the inequality 


IT@I s Kix] xeV 


Obviously, ||7(x)|| is the norm in W and ||x|| is the norm in V. 
We begin by deriving several conditions equivalent to continuity for a linear transformation. Our 
theorem shows that linearity and continuity together form a rather strong condition. 


Theorem 80.1 Let V and W be normed linear spaces and let T be a linear transformation from V 
into W. The following statements are equivalent: 


(1) Tis continuous on V. 

(11) 71s continuous at some point a in /. 
(111) Z1s uniformly continuous on /V. 
(iv) There exists a constant K such that 


\7(x)| < Kix = forallxeV 
(v) The set 


A = {||T@)h | xe Vand |x] = 1} 


is bounded. 
(vi) The set 


B= {|T@)l | xe Vand |x|] = 1} 


is bounded. 


Proof. Obviously (1) implies (11). 

Assume that 7 is continuous at a. Let ¢ > 0. Then there exists 6 > 0 such that if ||x — al| < 6, then 
|| 7) — T(a)|| < €. If |x — y|] <6, then ||(@@ + a — y) ~ all = |x — yl] <8 so || + a — y) — Tia)|| <e. 
Since T(x + a — y) — T(a) = T(x) — T(y), (ii) implies (iii). 

If Tis uniformly continuous on V, then 7'is continuous at 0, and thus taking ¢ = 1, there exists 6 > 0 
such that if ||x|] < 5, then ||7(x)|| <1. Letxe V, x ¥ 6,x #9. Then 


é 
=5<9 


._ 
2\|x\| 


ecw <1 


This inequality reduces to 


IT@ < Fla) forxe Vx #8 


Therefore, if we take K = 2/6, then ||7(x)|| < K|lx|| for xe V, x # 6, x # 0. However if x = @, then 
|| 7()|| = 0 < K||x|| and thus (iii) implies (iv). 
Assume (iv) holds. Let x € ¥, |x|] < 1, |||] < 1. By (iv), 


IT) < Kix] < K 


and thus A is bounded by K. Therefore (iv) implies (v). 
Since B C A, if A is bounded, then B is bounded, and thus (v) implies (vi). 
Assume B is bounded by K. Let ¢ > 0. Let 6 = ¢/(K + 1). Suppose ||x — y|| < 6. Ifx 4 y, ||(x — y)/||x 


— y|| || = 1, and thus 
eee Pe 
[r ( = i) 


Thus IZ@) — TO)| = 17% — yl < Kix — yl] < KS <e 


<kK 


On the other hand, ifx = y, then ||7(x) — T(y)|| = 0 <, and therefore (vi) implies (i). 


Theorem 80.1 states that the linear transformation 7 is continuous if and only if 7 1s bounded on the 
unit ball 


ixe V| [xi] < 1} 


For this reason, continuous linear transformations (on normed linear spaces) are sometimes called 
bounded linear transformations. 

The norm for R is the absolute value, and thus by Theorem 80.1 a linear transformation 7 from a 
normed linear space V into R is continuous if and only if there exists a constant K such that 


|Z(x)| = K|x|| for allxeV 


We will use this condition to verify continuity in each of the following examples. We leave to the 
reader the (easy) task of verifying that each of our functions is linear. 


Example 80.2 Define 7: R” — R by the equation 
T(x) = x, 
where x = (x,,...,x,) € R". Then 


[T&)| = ley] < xd +--+ + x2 = |x] 


and thus 7 is continuous on R”. 


Example 80.3 Let {a,} ¢ ?. Define T: ? — R by the equation 
T(x) = Ss IyXq 
where x = {x,} ¢/’ . By the Cauchy-Schwarz inequality (Theorem 36.6) we have 


< [Sa /$ x= xia 


where K = /¥@, @ and thus 7 is continuous on /’. 
Throughout this chapter, the norm on C[a, b] is the sup or uniform norm (see Section 60 and 
Theorem 69.2) 


iT =| Faye 


fll = lub {1/@)] | x [e, d]} 
for all fe Cla, b]. 


Example 80.4 We come now to the central example in this chapter. Let p(x) = V%o and let « e BV[a, 5] 
be the total variation function (see Section 54). Define 7: Cla, b] — R by the equation 


Tf) = [fae for all fin C[a, 5} 


Let fe C[a, b]. The function | f'| is in R,[a, b] (Theorem 55.6) and since |Ax)| < || || for x in [a, 5], 
we have [Theorem 51.13(iv)] 


b a] 
| iflaB < | LF dB = II | dp = (FIB® — Ba) = (VII 
By Theorem 55.6, we have 


IT(AI = \f fa 


b 
s | iflgs < (*ML/I 
and thus 7'is continuous on C[a, 5]. 
Exercises 


80.1 Let V be a normed linear space. Let {x,} and {y,} be sequences in V which converge to x and 
y, respectively. Let {c,} be a real sequence which converges to c. Prove that {c,x, +y,} 
converges to cx + y. Prove that {||c,x,|| converges to ||cx||. 

80.2 Letc ela, b]. Prove that the equation 


T(A) = flo) 


defines a continuous linear transformation on C[a, b]. Prove that there exists « ¢ BV[a, 6] such 
that 


TU) =| fda 


80.3" Prove that any linear transformation from R” into R is continuous. 
80.4 Let {¢,} €/°. Define 7: /” > R by the equation 


Ms 


T(x) = >) 4%, 


i} 
_ 


where x = {x,} ¢ /”. Prove that 71s continuous on /”. 

80.5 Let c be the set of all convergent (real) sequences. If x = {x,}¢e, let {Jx|] = lub {[xzl Jz € P}- 
(a) Prove that c is a normed linear space. 
(b) Prove that the equation 


T(x) = lim x, 
47% 


x = {x,} ¢ defines a continuous linear transformation on c. 


80.6° Let g[0, 1] be the subspace of C[0, 1] consisting of all polynomials on [0, 1]. Prove that the 
linear transformation T from g[0, 1] into R defined by 


T(p) = p(2) 


is not continuous on g[0, 1]. 


80.7 Let V and Wbe normed linear spaces and let 7 be a linear transformation from V into W. 
Prove that 7 is continuous on V if and only if the set 


{{[7@)|| | x V and |}x|| < 1} 


is bounded. 
80.8 Prove that the map T: R* — C[0, 1] defined by 7(a, f, y) = ax* + Bx + y is a one-to-one, 
continuous linear map. Is the mapping T7': 7(C[0, 1]) — R° continuous? 


81. The Normed Linear Space of Continuous Linear Transformations 


Let V and W be vector spaces. Let y'(V, W) denote the set of all linear transformations from V into W. 
The set ¢'(V, W) is itself a vector space if we define operations pointwise 


(T + U)(x) = T(x) + U(X) (cT)() = c(T(x)) 
for all T, Ue GW, W), xeV,ceR 


If V and W are finite-dimensional vector spaces of dimensions n and m, respectively, y'(V, W) is 
identified with the space of all m x n matrices. 

If V and W are normed linear spaces, we may consider the subset y(V, W) of ¢'(V, W) of all 
continuous linear transformations of V into W. The next theorem states that y(V, W) is a subspace of 


Z(V,W). 


Theorem 81.1 Let V and W be normed linear spaces. Then y(V, W) is a vector space where the 
operations are defined pointwise. 


Proof. We verify that g(V, W) is a subspace of ¥'(V, W). It suffices to show that if 7, Ve Z(V, W) 
andc éR, thencT + 7, Ve LY, W). 


Let 7, Ve 2, W) and ce R. By Theorem 80.1, there exist constants K, and K, such that 
| 7(x)|| = K;,||x] | U(x)|| <= K,||xl) forallxeV 
Thus ifx « V, 


eT + U)@)ll = heT(X) + UG) < lell TE) + 1OC)I 
= lel, |x|] + alll 
= (lelKy + Kp)Ix] 


and by Theorem 80.1, c7 + Uis continuous. 
We next show how to define a normon ¥(V, W). 


Theorem 81.2 Let V and W be normed linear spaces. Then the equation 


|Z] = lub {i 7()I] | xe V and |x|] = 1} 


defines a normon #(V, W). 


Proof. lf Te #V, W) let 
Ar = {T(x | xe V and ||x]| = 1} 


By Theorem 80.1, A, is bounded, and hence lub 4, exists. 

If T = 0, then A, = {0}, and hence ||7]| = 0. If ||7|| = 0, then 4, = {0}, and hence 7(x) = 0 if 
Zl] = 9 and ||x|| = 1. If x € V and x  @, then ||x/||x|| |] = 1, and hence ||7(x/||x|])|| = 0. Thus 7(x) = 0 
ifx ¢ V and x # @, and it follows that T= 0. We have shown that ||7|| = 0 if and only if T= 0. 

Let 7, Ve #(V, wy andc €R. Ifc = 0, then 


eZ] = 0 = |e|||7] 
and thus we suppose c # 0. Ifx « Vand ||x|| = 1, then 
KeT))I = lel ITE) s lel IT 
and hence leTI < [ellITI 
On the other hand, if x ¢ V and ||x|| = 1, then 
KT) = lel IT) = lel IT 


Therefore, | 7¢@)| < —|eT|| for x ¢ V with ||x|| = 1, then 


=| 

~ fel 
1 

and hence T(x) < iq !e7l 


It now follows that ||c7|| = |c| ||7/]. 
Finally, let 7, ve YY, w). Ifx € V and ||x|| = 1, then 
ITO < ITh =U) s IM 
Therefore, 
IF + YO) = IT) + UCD = ITED + |U@) s IT] + 17] 
and it follows that 
I+ Ul s IT] + IU] « 


We next give two other characterizations of the norm of a continuous linear transformation. 


Theorem 81.3 Let V and W be normed linear spaces and let Te ¥(V, W). Then 


IT] = to. {| T(x] | xe V and ||x]] < 1} 
glb {K | TQ) s Kix], xe V} 


Proof. Let 
A = {||T(x)l| | xe V and |x] < 1} 
B= {\|T@)I| | xe V and |x|] = 1} 
C = {K| |T(x)]] s K|x|, xe V} 
Since B C A, 


7] = lub B < lub A 
Let Ke C. Ifx ¢ V. and ||x|| < 1, then 


|7()|| = K]|x|| = K 


(81.1) 


and thus K is an upper bound for A. Therefore, lub A < K. This inequality states that lub A is a lower 


bound for C, and hence 


lub A < glbC 


(81.2) 


Ifx ¢ Vand x #0, then ||x/||x|| || = 1, and hence ||7(x/||x||)|| < ||Z||. This reduces to |]7(x)|| < ||| 


||x|| for x # @. This inequality is also valid ifx = 0, and thus 
IT@I s ITI Ix] xeV 
Therefore ||7|| ¢ C, and hence 
glb C < ||T | 


Inequalities (81.1) to (81.3) now give the desired conclusion. gm 


In the course of the proof of Theorem 81.3 we proved the following important fact. 


Corollary 81.4 Let V and Wbe normed linear spaces and let Te ¥(V, W). Then 
(7) < IT) xi for allxe V 
Proof. See the proof of Theorem 81.3. 


Examples. Let T be the linear transformation from R” into R defined by 


T(x) = x, 


(81.3) 


where x = (X,,...X,) € R” . We proved (see Example 80.2) that Tis continuous and that 
|T(x)| <= 1-]xl] for all x e R” 


By Theorem 81.3, ||7|| <1. 

Let OY = (1, 0, ... , 0). Then ||6@|| = 1 and since 7(6) = 1, by Theorem 81.2 7(6) = 1 < ||7|I. 
Therefore, ||7|| = 1. 

Let {a,} €1,. Let T be the linear transformation from / into R defined by 


TW) = ¥ a,%, 
n=1 
where x = {x,} «/?. We proved (see Example 80.3) that 7 is continuous and that 


|7(x)| < jal xl] —s for all x e/? 


By Theorem 81.3, ||7|| < |la||. If a = 0, we have ||7|| = 0 = |lal|. If a # 0, then 7(a) = |la||? and thus 
T(a/lal]) = |la||. Since ||a/|lal| || = 1, we have ||a|| = T(a/||a||) < ||7||, and therefore ||7|| = |Jal]. 


Exercises 
81.1 Let V and Wbe normed linear spaces and let Te ¥(V, W). Prove that 


[|7 || = lub {|/7@)]| | x ¢ Vand |[x|| < 1) 


81.2 What is the norm of the linear transformation of Exercise 80.2? Compare this value with v2. 
81.3. What is the norm of the linear transformation of Exercise 80.4? 
81.4 What is the norm of the linear transformation of Exercise 80.5 ? 
81.5 Let V, W, and_X be normed linear spaces and let Te (V, W) and Se gy, W). Prove that 
Te Se Xv, x) and 


7° SI < {ITI ISI (81.4) 


81.6 (a) Prove that any linear transformation from R” into R” is continuous. 
(b) Let Tbe an invertible linear transformation from R” into R". Prove that 1 < ||7]| ||7 “I. 
Give examples to show that either < or = may occur. 
(c) Let re g(r*,R"). Let c,, ..., c, be the (possibly complex) eigenvalues of 7'T. (‘ denotes 
transpose.) Prove that 


I7]] = max {/Tea], «Teal, ..., Teal} 


81.7 A linear algebra which is a normed linear space whose norm satisfies equation (81.4) is 
called a normed linear algebra. Prove that R", C[a, b], , c), and /” are normed algebras 
(multiplication is defined pointwise). A complete normed algebra is called a Banach 
algebra, and thus each of the spaces above furnishes an example of a Banach algebra. 


81.8° Prove that the set of power series y=, a,x" is a vector subspace of C[a, b]. Is this subspace 
complete? 


82. The Dual Space of a Normed Linear Space 


The dual space of a normed linear space V is the set of all continuous linear transformations from V 
into R with the norm defined as in Theorem 81.2. 


Definition 82.1 Let V be a normed linear space. The dual space V’ of V is the space ¢(V, R) of all 
continuous linear transformations from V into R. 
The norm on /” is given by 


|Z] = lub {]7(@)| | xe V and |x] = 1} for each Te V* 


The elements of V" are called continuous linear functionals. 

An interesting problem in functional analysis is to identify the dual space of a given normed linear 
space. As examples, we show that (R")” may be identified with R” and ¢# may be identified with J’. 
The Riesz representation theorem states that (Ca, b])° may be identified with BV[a, 5]. 


Theorem 82.2 Let Te (R")*. Then there exists T(x) = 3 xa for allx = (x,,...,x,)¢R® Such that 
k=1 


T(x) = = xq for all x = (xy,...,%,) €R” 
and [71] = lal 
Proof. Let Te (R")*. Let 
SO iP 6) cosh 1ZO cy 
where the number | appears in the Ath coordinate. Set 
a= 7T(6) fork=1,...,n 


and leta=(a,, ... , d,). 
If x = (x,,...,%,) €R", then 


T(x) = r{ y 0%) = ¥ x76) = }i xa, 
k=1 k=1 k=l 


< ab x J Ya? = |xi| lal 
k=1 k=1 


so by Theorem 81.3, ||7|| < |[al]. 


Now |7(x)| = 2, XA 


Ifa =9, ||7|| = 0 = |lal|. If a 4 9, we argue as in the last example in Section 81 to prove that ||7|| > 


||al|. Therefore ||7|| = |[al|. 
Similar methods identify the dual space of c,. 


Theorem 82.3 Let Te cg. Then there exists g = {¢} ¢/ such that 
T(x) = 3 xa for allx = {x} € co 
n=1 


and ||7|| = lal. 
Proof. Let Te cx. Let 


and set 
a, = T(d”) 
Let x = {x,} ee, and lety = ye_, x,6. Then 
Tin) = T(¥ m8®) = FF) = Y nas 
k=1 k=1 k=1 

Now 

Va -x= (0, 0, ee argh ams baits oe ) 

and thus |jy, — xl] = lub {lx | > 7} 
Hence lim |ly, — x|| = lim lub {|x,| | & > } = lim sup |x,| = 0 

nev nvr ae mt co 
since {x,} ec. Thus lim, ... y, = x inc, and since 7 is continuous 
T(x) = lim T(y,) = lim ¥ xa, = Yo xnGn 
amr nwa k=l n=1 


We next show that g = {g,} ¢/. To this end let 


1 ifm < nanda, > 0 
yO=<-1l ifmsnanda, <0 


0 ifmon 


Then Ty) = x, ya, = = lal 
Now y ¢¢, and ||y|| = 1; so by Theorem 81. 2 


ITO) < ITI 


(82.1) 


Thus ¥° Ja, < Tl) forn =1,2,... 
By Théorem 24.1, g-;. Taking the limit in equation (82.1), we have 


lal = ¥ lawl < OT 
On the other hand, if x € ¢g and ||x|| = 1, then 


wo wo @ 
IT) -|5 ala] SV eal <3 Yen] = Hal 
n= n= ns 


By Theorem 81.2, ||7| < |lal], and hence ||7|| = |lal|. 
Exercises 82.2 and 82.3 show that (/')" may be identified with /” and that (/’)” may be identified 
with P’. 


Exercises 


82.1 Let Tbe as in Theorem 82.3. Does there exist x €¢p, |[x]] = 1, Such that 7(x) = ||7]|? 
82.2 Let pe¢qy+. Prove that there exists a = {a,}¢/° such that 


T(x) = b7 Xe  forallx= {x,}el 


and ||7]| = ||al]. Does there exist x ¢,||x||, such that 7(x) = ||7||? 
82.3 Let p¢qays. Prove that there exists a = {a,}¢/? such that 


T(x) = p34 Xn, for allx = {x,}e/? 
nm 


and ||7]| = ||al]. Does there exist x €2,||x||, such that 7(x) = ||7]|? 
82.4 Show (by example) that there exists ye ¢* such that for no sequence a = {a,} do we have 


T(x) = by Ma,  forallx = {x}eEc 


(The space c is defined in Exercise 80.5.) 
82.5 Let V and Wbe normed linear spaces. An isometry from V onto Wis a linear transformation T 
from V onto W satisfying 


I7@)|| = ||x|| for allxe V. 


(a) Prove that if 71s anisometry from V onto W, then Tis a continuous vector space 
isomorphism of V onto W with continuous inverse. 
Because of (a) if 71s an isometry of V onto W, V and Ware said to be isometrically isomorphic. 
(b) Prove that if V and W are isometrically isomorphic normed linear spaces, then 
(i) IfVis complete, then Wis complete. 


(ii) Vis isometrically isomorphic to W. 
Does the converse of (11) hold? 
(c) Prove that the following pairs of normed linear spaces are isometrically isomorphic. 
G) RY (RY 
(ii) (@)", 2 
(iii) (/')’, 1” 
(iv) (P),P 
If we identify isometrically isomorphic normed linear spaces, we can state, for example, that the 
dual space of c, is /'. 
82.6 Let V and Wbe normed linear spaces with W complete. Prove that y(V, W) is a complete 
normed linear space. Deduce that the dual space of any normed linear space is complete. 


83. Introduction to the Riesz Representation Theorem 


In Example 80.4 we showed that if « ¢ BY[a, 5], then the equation 


T(f) = [fae for all fe Cla, 5] (83.1) 


defines a continuous linear transformation from C[a, b] into R. That is, re (Ca, b)*. It also follows 
from Example 80.4 and Theorem 81.3 that 7 < v*« (verify). The Riesz representation theorem is the 
converse of the above: if re(Cfa, s)*, then there exists ge BY[a, b] such that 7(f) = f' f dy. Moreover, 
we shall show that \7] < v*g. Thus the Riesz representation theorem states that (C[a, b])’ may be 
identified with BV[a, 5]. Linearity is one of the fundamental properties of the integral (Theorem 
53.2). The Riesz representation theorem shows that linearity and continuity characterize the Riemann- 
Stieltjes integral with respect to continuous functions. 

Let Te (Ca, b)*. To prove the Riesz representation theorem, we must define a function a on [a, 5], 
prove that « ¢ BY[a, b], and finally show that equation (83.1) holds. Consider the problem of defining 
a. If T satisfies equation (83.1) [and a(0) = 0], we could recover a from this integral representation 
as follows. Let 


1 asysx 


£o= 4, x<ysb 


(See Figure 83.1.) Ifa is right continuous at x, we have 
> ‘x 
[_60) data) = [ae = a 


Thus, if the domain of T included the functions f,, we could define a(x) = 7(f,). Unfortunately, f, is not 
continuous (unless x = 5), and thus f, is not in the domain of 7. The major part of the proof of the 
Riesz representation theorem consists of extending the domain of T to a subspace of Bla, 6] which 
includes the functions f,. Once we prove that an extension 7’, of T to an appropriate subspace exists, 


we can define a(x) = T,(f,). 

Note that f, is the pointwise limit of a decreasing sequence {f,} of continuous functions on [a, 5]. 
(See Figure 83.1.) We will prove that lim, .., 7(f,) exists. It then seems reasonable to define the 
extension 7, by the equation 7,(f,) = lim,_,,. T(f,,). This 1s exactly the method we shall employ. 

In the remainder of this section we define some of the notation we will use in the proof of the Riesz 
representation theorem. 

Iffand g are functions on [a, b], we write f > g if f(x) = g(x) for all x in [a, 5]. 

We let C, denote the set of all bounded functions f on [a, b] such that fis the pointwise limit of a 
sequence {f+ in Cla, b], where 


Sn = Sass n=1,2,... 


As we noted above, C, contains the functions f.. Itis also clear that C, > Cfa, 8). 

The set C, is not quite a vector space, but we do have 
(i) If £gec,, then f+ gec, (83.2) 
(il) If fe C, and c > 0, then ¢fec, 
To prove (11), let ¢fe c, and let c > 0. Then there exists a decreasing sequence {f,} in Cla, b] such that 
{f,} converges to f pointwise. Since c > 0, {cf,} 1s a 


ty 


Figure 83.1 


decreasing sequence in Cla, b] such that {cf,} converges to cf pointwise. Therefore, efe c,. Part (i) is 
proved ina similar way. 

Since —f,¢ c, (verify), C, is not closed under scalar multiplication, and thus C, is not a vector 
space. This difficulty necessitates enlarging our set of functions still further. Fortunately, this last 
extension is easy. We simply define 


C,={f-g9lfgeCs} 


Using (83.2), it is easy to verify that C, is a vector space. Clearly C, contains C, and C[a, b]. Also 
C, < Bla, 4]. 

Functions such as f, which assume only the values 0 or 1 play an important role in mathematics and 
are known as characteristic functions. In the remainder of this book we shall employ the following 
notation for a characteristic function. Let _X be a set. We define 


1 ifxe X 


Xa) ‘, ifx¢ X 


Thus f. = Xax 
One last bit of notation and we shall proceed to the proof of the Riesz representation theorem. If a 
is areal number, we define 


] ifa>O 
sgna = 0 ifa =0 
—] ifa <0 


It is then clear that |a| = (sgn a)a for all ger. 


Exercises 
83.1 Verify that if Tis defined by equation (83.1), then ||7\| < V,«. 
83.2 Let e¢ fa, b]. Define a on [a, b] by the equation 


@=f a@ixeec 
a | ecxzgb 


Define T by equation (83.1). Prove that rj < Vw. 
83.3 Prove (83.2)(ii). 
83.4 Prove that —p¢¢,. 
83.5 Prove that x< ¥ and C, ¢ Bia, 6). 
83.6 LetX and Ybe sets. Prove that + - ¥. Derive a formula for yxuv.. 
83.7 Let Wbe a subset of a vector space V such that 


xtyew ifx,yeW 
exe W ifxeWandc>0 


Prove that 
U= {x-—y|x, ye W} 


is a Subspace of V. 
83.8 We say that fis upper semi-continuous (usc) at c if for every ¢ > 0, there exists 6 > 0 such 
that if  — c| < o, then f(x) < f(c) + €. We say that fis usc on a setU = {x —y| x, ye W}iffis 
usc at each point of X. 
(a) Prove that fis usc on. X if and only if f~'[(— ©, f)] is open in_X for every seR. 
(b) Prove that fe c, if and only if fis a bounded, upper semi-continuous function on [a, 5]. 


84. Proof of the Riesz Representation Theorem 


In this section we state and prove the Riesz representation theorem. We use the notation of Section 83. 


Theorem 84.1 (Riesz Representation Theorem) Let [a, b| be a closed interval and let 
T ¢ (Cla, b))*. Then there exists ¢ ¢ BY[a, 6] Such that 


rip) = | fate for all fe C[a, 5] 


and | 7] < V*q. 


Proof. Let Te (Cla, b)*. We begin by extending T to C,. Let fe C,. Then there exists a decreasing 
sequence {f,} in Cla, b] which converges pointwise to f. We first show that lim, _. 7(/,) exists. 
Let 9, =f, ~fap n=1,2,....Lete, =sgn T(9,),n=1,2,.... If xe€ fa, bj, then 


n 


oy G(X) 


k=1 


< 3 bus) = AG) — 40) 
< fs) - f0) < If — SI 


Thus [3 a6| <A -s 
og Rilo = 3 ta = 1(F et) 
< ITI) S ext) < ITH — 21 


By Theorems 24.1 and 26.2, Y2, T(¢,) converges. Since 


Th) = Th) - » Tey 


k=1 


it follows that lim, _.,. 7(f,) exists. We define 
T,(f) = lim T(f,) (84.1) 


We next show that definition (84.1) is independent of the choice of the sequence {f,}. That is, we 
show that if {f,} and {g,} are decreasing sequences in C[a, b] with pointwise limit f, then lim, 


Let 


1 
Fy = In +7 G, = 9, += 


Then lim 7(¥,) = lim T(4) lim 7(G,) = lim T(g,) 


Also {fF} and {G,} are decreasing sequences in C[a, b] with pointwise limit f, Furthermore 


B>=f @& Sf  Fforw= lh Bans (84.2) 


Let n, be a positive integer. We will show that there exists a positive integer m, such that F,, > G,,, 
. Let 
E,, = {x é[a, b]|F,,{x) > G,(x)} form=1,2,... 


Since F, and G,, are continuous, £,, is open for every positive integer m. Because of equation (84.2) 
and the fact that {G,} converges pointwise to f, the family {£,,} covers [a, b]. Because [a, b] is 
compact some finite subcollection of {£,,} covers [a, b]. But 


E,cE,¢°> 


SO E,,, covers [a, b] for some positive integer m,. From the definition of £,,,, it follows that F,, > Gyy,- 
Arguing as above, we construct a sequence such that 


Pe ecg elgg ee glee 2a 


Let H,, = G,,, and Ha,_, = F,,. Then {H,} is a decreasing sequence in C|a, b] with pointwise limit 
f. Therefore lim,_,,. T(/,) exists. Now 


lim 7(f,) = lim T(F,) = lim T(F,,) = lim T(H 2-1) 
no ko koa 


u--@ 


lim 7(H,) = lim 7(G,,) = lim T(G,) = lim T(g,) 
ko @ ko n- co n-* co 


Thus equation (84.1) is independent of the choice of the sequence {f,}. It also follows by taking f, =f 


that T\(/) = T(f) if fe Cla, B]. 
It is easy to show that if £ ge C, and c= 0, then 


Ti(f + 9) = 71) + T1@) T (cf) = cT,(f) (84.3) 


Lethe C,. Thenh =f— g, where £, g € C,. We define T, on C, by the equation 


T,(h) = Tf) - T1) (84.4) 
We show that equation (84.4) is independent of the representation of h. That is, we show that if 
fAi-G =h=fp- G2 


where f,, 91, fay g2 €Cy then T\(f,) — T\(g,) = T,\(f) — T\(g,). Since f, + g, = f, + g), by equation 
(84.3), T,\7,) + T\(g>) = T,5) + T\(g,) and hence equation (84.4) is independent of the representation 
of h. 

It follows easily from equations (84.3) and (84.4) that 7, is a linear transformation on C, which 
agrees with 7 on C[a, b]. 


We next show that 7, is continuous on C, and ||7,|| = ||7]|. Let 4 e C,, where ||A|| < 1. Thenh =f— g, 
where f£, g € C,. There exist decreasing sequences {f,} and {g,} in Cla, b] which converge pointwise 
to fand g, respectively. Leto, =min {f,,¢g,+ 1} forn=1, 2, ....Then {g,} is a decreasing sequence 
in Cla, 5], and it follows from the inequality 


Q,t+1l>gG,thezgth=f 


that {g,} converges to f pointwise. Therefore 
lim T(p,) = T,(f) 


Let y, = min {g,,9,+ 1},n=1, 2,... . Then {y,} is a decreasing sequence in Cla, 5], and it 
follows from the inequality 


?,+lef—h=g 


that {y,} converges to g pointwise. Therefore lim,_,,. 7(w,) = T,(g). 
Since yw, <@, + 1, it follows that 


',-o si (84.5) 


Now y,,(x) = g,(x) or w,(x) = 9,(x) + 1. Ify,@x) = g,(x), then y,(x) — 9,(x) = g,(%) — (g,Q) + I) =—1. 
Ify,(x) =9,(x) + 1, then y,(x) — 9,(x) = 1 =-—1. In any case 


Vs, = Px = = (84.6) 
Combining equations (84.5) and (84.6), we have 
n—~ Pall S ] 
vn — Pal (84.7) 
Therefore 
Taking limits in equation (WA4)) weltfidl = 17 WU. — $,)| = ITI 
IT7W@) — TI < ITI 


Thus 
[7A] < IT} for |All < l,kAeC, 


By Theorems 80.1 and 81.3, 7, is continuous on C, and ||7,|| < ||7||. On the other hand, 


72h = lub {17,@)] | Al s 1,4eC,} 
= lub {|72(A)| | lll < 1, 4 Cla, b}} 
= lub {|7(@) | All < 1, 4 Cla, d]} 
= (7 


Therefore ||7,|| = ||7']. 
We showed in Section 83, that if ¢ ¢ [a, 5], then %, .7¢ Cy. Thus ifa <c <d <b, then 


Xe.) = Xta,a] — Xta,e © C, 
Define 
a(x) = T2(Xto,x1) for all x € [a, 5} 


We next show that «¢ BV{a, 6] and vty < \\TI. 
Let {x9,X,,.-.,%,f be a partition of [a, b]. Let e, = sgn T2(%.,_,,.9) for i= 1,...,n. Now 


a(x;) — o(x;-1) = TXta.x:) — T(Xta,s:-4)) 
— T2(%a,x13 — Pcie 
= T2(Xx:- 1,2) 


Also g = S.4 €%¢x,-4,x9 € Cz and ||g|| < 1. Thus 


x Jor(2e;) — a{o;-1)| = x IT 2(Xeep-s,xapl 
= »y €:0o(X¢e,-1,) 
= T,(g) = Tall = ITI 
Therefore « ¢ BY[a, b], and 
Vie s ITI (34.8) 
Finally, we show that 7(f) = [¢ fde for fe Cla, 6] and |r < vtx. Let fe Cla, p] and let « > 0. 
Since fis uniformly continuous on [a, b], there exists 6 > 0 such that if [x — |< 0, then f(x) — f(y)| <«. 
Let P= {1 V1, --- > ¥,,$ be a partition of [a, b] with max {ly,—y,_,|| 1 <i<m} <6. Let P = {x, x, 


.. , X,$ be a partition of [a, b] containing P and let ¢,e[x,_,,x,] fori=1,...,n. If xe fa, 6], there 
exists a positive integer j, 1 <j <n, such that x €(x;_,, x,]. Now 


FC) — Y [Mexrxa| = L1G) ~ Me < « 


since |x — ¢| < 0. Thus | f— Y%4 f(t) x%,-3,x,ll < &- Therefore, ift = {t, ...,t,}, we have 


ITA) = (4 P*, ol =| TC) — ¥ fleolets) — ate) 


a 


Tf) — XY MtdT era) 


isi 


= 


TL — ¥ federal 


< ||T.| 


i 2 SOK 


< |lThlle 


By Definition 53.1, 7(f) = §* fda. By Example 80.4 and Theorem 81.3 7¢f) = f° fd and combining 
this inequality with (84.8), we have j7j < Vo. m 


Exercises 


84.1 Prove equations (84.3). 
84.2 Prove that 7, is a linear transformation on C, which agrees with 7 on C[a, 5]. 
84.3 Prove that the function a constructed in the proof of the Riesz representation theorem 1s right 
continuous at every point of [a, 5). 
84.4 We call a linear functional T in (C[a, b])" a positive functional if T(f) > 0 whenever f> 0 and 
fe C[a, 5]- 
(a) Let re (Ca, b|)*. Prove that T is a positive functional if and only if there exists an 
increasing function a on [a, b] such that T(f) = Sof de for all fin Cla, 5]. 
(b) Let re (Cfa, b)*. Prove that there exist positive functionals U and V in (C[a, b])” such that 
T=U-YVS. 
84.5 Let ge a, 5). Prove that if we define 7(f) = ft f(x)g(x) dx, then T¢ (C[a, b)*. Apply Theorem 
84.1 and describe the resulting a. What is ||7||? 
84.6 (a) Let re(Cfa, b)* and suppose also that 7(f-g) = (7(f))(7(g)), for all £ g © C[—1, 1]. Prove 
that there exists ¢ «{—1, 1] such that 7(f) = f(c) for fe C[—1, 1}. 
(b)" Let re (Ca, b)* and suppose also that 7(f-g) = (7(/))(7(g)) for all £ g © Cla, 6]. Prove that 
there exists ¢¢[a, oj such that 7(f) = f(c) for fe Cha, b]- 
(c)* Prove that if 7 is a linear transformation from C[a, b] into R satisfying 7(f-g) = (7(f)) 
(7(g)) for all £ ge Cha, 6], then Te (Ca, A)*, and hence by part (b), 7(f) = f(c) for some c 
in [a, 5] and for all fe Cfa, 5). 
This exercise shows that the multiplicative linear transformations from Cla, b] into R may be 
identified with the points of [a, 5]. 


XIV 


The Lebesgue Integral 


Consider the set S of rational numbers in [0, 1]. Since S is countable, we let § = {¢,}~, be an 
enumeration of S. Forn=1,2,..., the function 


] for x = a, withi=1,2,3,...,m 


a & ra 
le) ‘ for all other x € [0, 1] 


is Riemann integrable and 
1 
| ST Ax) dx = 0 
) 


Since 0 <f\(x) <f,() < +--+ <1 for all f(x) = lim,.,,, f(x), we let f(x) = lim,_,,, f,«) for each x € [0, 1]. 
Clearly 


] ifxeS 


f(x) = ‘0 for all other x € [0, 1] 


It seems reasonable that f should have integral 0, since each f, has integral 0. However, since 


[fo a =] [700 dx = 0 


f is not even Riemann integrable. This is an inadequacy of the Riemann and Riemann-Stieltjes 
integrals, which we now attempt to remedy. 

Why is f not Riemann integrable? The fault lies not with the average used, namely a(x) = x, but 
rather with the sets we averaged over, i.e., intervals. Using intervals is too restrictive. We now set a 
new goal. We wish to carry our concept of integral one more step, so that the class of functions which 
we can integrate is much larger than R[a, b] and so that the integral will not only retain the properties 
of the Riemann-Stieltjes integral, but will have additional properties which will allow us to deal with 
the integral of the limit of functions. 

To keep the abstract flavor of this integral, we develop it from its rudimentary definitions and 
finish with examples of this integral on the real line. 


85. The Extended Real Line 


To accommodate our integration and measure theory, we now extend the real line R by adjoining two 
points, denoted oo and — oo. The order relation < and the operations of addition and multiplication are 


also extended in a natural way, with the exception of 0 - «© and «© — o. We let 0 - 0 = 0, since we 
wish to ignore what happens on sets of measure zero. However, 0% — oo remains undefined since 
situations in which oo — oo occur constitute major sources of difficulty in measure theory. 


Definition 85.1 
(i) R=Rv {w, —o}, 
For anyxyeR 
(41) —o<x<o and —0o<oo, Also <has its usual meaning on R. 
(iii) xto=otx=0to=oandx-w=—-o+x=—-0-«0=—o, Also + has its usual 
meaning on R and — has its usual meaning on R. 
(iv) Ifx>0, thenx -0o=0-x=0+o=(—0):(—0)=o and x: (— 0) =(— ©):x =a-(- 
00) = (— 0): 0 =— oo, - has its usual meaning on R. 
(v) Ifx <0, then x-00 = 0o:x =— oo and x:(— ©) =(— 0)-x =o, 
(vi) O-:00o=00:0=0:(— 0) =(—&):0 = 0. 
Therefore, the extended operations + and - are still commutative and associative, but the distributive 
law fails in R. For example; 00-(3 — 2) = 00-1 = 0, but (00-3) — (002) = 00 — 00 is undefined. 
We shall sometimes refer to a function f: x — [— 0, «] which takes on only real values as finite 
valued. 


Definition 85.2. For a, 8¢ R, a < & define 


[a,b] = {xeR|a<x sb} 
(a, b] = {x eR| a < x < 5} 
(a,b) = {xeR|as x <b} 
(a,b) = {xeR|a<x <5} 


Any of the above sets is called an interval of R. The open sets in R are the open sets of R together 
with sets of the form Y u J, U J,, where U is open in R and /, and J, are intervals of R of the form [- 
00, a) or (a, ©] for [—%, a) or (a, 0] for ae R.. 


Example. (—1, 1) u (5, oo] is an open set in R. Also [—00, ©] = [—,1) U Sv (0, &] is an open 
set in R. 


Note. [— 00, 00] = R. We will use these notations interchangably. 


Exercises 


85.1 Show that the open sets of R forma topology for R 
85.2 Define a metric on R, such that the metric topology is identical to the topology in Exercise 
S51. 


86. o-Algebras and Positive Measures 


Definition 86.1 Let X be a set. A collection of subsets .@ of X is said to be a o-algebra in X if 
(i) Bed, 
(ii) Ae .wimplies 4’eM, 
(iii) 4n€ forn=1,2,3,... implies Ur=1 4n€ 


Examples. Let X be any set and recall that P(X) denotes the collection of all subsets of X. It is 
easily seen that P(X) is a o-algebra in_X. 

Another o-algebra in X is & = {2, X}, which also trivially satisfies Definition 86.1. 
Note that any o-algebra in_X always lies between the o-algebras {2, X} and P(X). 


Definition 86.2 Let .@ be a o-algebra in_X. A function uw from into [0, ©] is called a positive 
measure on Aé if 
(i) For at least one set A € .%, we have (A) < ~. 


(ii) For 4¢.@ for n = 1,2,3...., and 4: 4; = © for each i # j, we have 
o( U 4y) = 3 aa 


This last property is called the countable additivity of uu. 

The property 4,0 A ;=B for each i # j is called the pairwise disjointness of {4,}%,. 
Alternatively, {4 }% , is said to be pairwise disjoint. 

If A,e # and u(A,) <0 forn =1,2,..., 5%, n(A,) is Just the usual sum of an infinite series of 
real numbers. Since (A,) = 0 forn = 1, 2,..., either the series converges or diverges to o. If u(A,) 
= 0 for some n, we define", u(A,) = 00. 


Definition 86.3 Let X be a set, be a o-algebra in_X and yw be a positive measure on .#, then we 
call the ordered triple (X, , 1) a positive measure space. 


Example 86.4 Let X be any set. Let # = g(X). For each 4 e P(X) define 


0 fdA=B 
u(A) =<number of elements in A_ if A has a finite number of elements 
CO if A has an infinite number of elements 


We call “ counting measure on g(X). It may be verified (Exercise 86.1) that CX, jw, ) is a positive 
measure space. 
We now prove some of the basic properties of a positive measure space. 


Theorem 86.5 Let (X, yw, 1) be any positive measure space. Then 


(1) u() = 90. 
(ii) IfA,,4,,...,A4, are in wand 4. 4 A,= ZB for eachi #/, then p(| Jf, A) = Xie uA) 


(iii) If4,e.m forn=1,2,..., then 2, 4,¢.M. Also (\i_, A,e.M forj=1,2,.... 


(iv) IfA and B are ing, then A\Be Mt. 

(v) IfA, < A, < A; cand each 4,e.#, then y(|)*,A,) = lim,..,, u(A,) 

(vi) IfAand Bare in yw, and y(A) < p(B), then u(A) < (2). 

(vii) If A, > 4, 5 A, > Witheach 4, e.# and u(A,) < ©, then mV, 4,) = lim, u(A,)- 


Proof. (i) By Definition 86.2(1), there exists 4, ¢.# with u(A) < oo. IfA, =A, A, = 9, A, = %,..., 
then 4,¢.# forn=1,2,3,...and4 n4 s=% for i # j; therefore by Definition 86.2(11), we have 
w(A) = w(\J2, A,) = E21 w(A,) < oo which implies “(%) = 0, for otherwise, “(2) > 0 would give 
E21 W(A,) = 00. 

(ii) IfA,,4,,...,A4, are in wand 4 q A, = @ fori #/j, then let A... =%, Ais =%,.-- 
Definition 86.2(11), we have 


u{ 0) 41) = »( Oe) = 3 lay = 3 may 


=1 


. By 


since u(A,,) = 0 for all m>n+ 1. 
Gi) IfA,e @forn=1,2,...,thenf\2, = (U@, Ay’ by DeMorgan‘s law. However, 
Aj, « .@ for each n; so | J”, 4’ .#, and therefore (2, Ai)’ e.#. Also (\i_, A, ¢.# using (11) 
and DeMorgan’s law forj=1,2,.... 
(iv) IfA and B are ing, then 4\B = 4n B’. Since 4 ey and RB’ <.y, we have by (ii1) that 


An B'€ dM. 
(v) Define B, =A, B,=A,\4,,...,B,=A,\4,_,,....By (iv), Be. for eachn=1,2,.... 


Also it is easily seen that B; n B, = @ for eachi #7. Therefore 


(0. B,) = ¥ WB) 


Clearly U2, B, = Us 4,- But Di, w(B,) = u(Uier B) = nA) for j= 1, 2, . . . by (ii). Therefore 


a i 
YB) = lim YB) = lim w(4,) 
a= ~7~om n= jrw 


se o( Ay) = lim p(A,). 
n= 1 n+ 
(vi) «Ac Bimplies that B = 4U(B\A). Since 4e.4, B\Ae.#, and An (B\A) = @, by (ii) we 
have 
(86.1) 


u(B) = w(A) + p(B\A) 
Since : yy — [0, ©], equation (86.1) implies that (A) < “(B). 
(vii) If4, > A, >,..., and each 4, e.# and u(A,) <0, we let B, = A,\4,, B, = A,\4,,...,B, = 
A\A Then B, ¢.@ for alln=1,2,...and B;n B, = @ for eachi #7. Now 


aes sd ae 


A, = A,u (Jari By and A, mn (Uzi B) = Bs 80 


w(A,) = plA,) + #(U, B;) a ae (86.2) 


Since yp:  — [0, co] and u(A,) < 0%, we have u(A,) < 0 and u((J%zi By) < 0 by (vi). Therefore equation 
(86.2) gives 


m¢0) B,) = u(A;)— A,) forn =2,3,... (86.3) 
fF 


Similarly, 4) 4,= a\(9 B,) 
n=l n=1 


again 4, =((4)u (02 


= 
. 


hak and () Bc Ay 
=1 
imply u( A) 4.) = ts) — a( UB) = aA) ~ 5 a8) 


= #(A,) - tim n (SF uB ») 
= Jim «fay - z 3) 
») 


“lee 


[u(A,) — p(A,) + 2fA,)] = ue H(A,) 


where we use equation (86.3) for the second to last equality. 
Property (11) above 1s called the finite additivity of uu. 


Example 86.6 In (vii) of Theorem 86.5 the assumption that u(A,) < 00 is necessary, for let X = Z, the 

set of integers, let yw = g(Z), and let ~ be counting measure on -w. If A, = {1, 2,3,...}, 4, = {2, 3, 4, 
a ee ae Oy me ee eee ., then each 4 e.# and 4, > 4,>5,..., but u(A,) =o forn = 

1,2,...;so lim... u(A,) = ©. However, w((\s= 1 An) = HC). So u(( \@1 A,) = 0 # © = lim,... HCA,). 


Exercises 


86.1 Prove that if X 1s a set, then @(X) is a o-algebra in_X and that counting measure (Example 


86.4) is a positive measure on g@(X). 

86.2 Use the measure space of Example 86.6 to give an example of each of parts (11) to (vil) of 
Theorem 86.5. 

86.3 Does there exist an infinite o-algebra which has only countably many members? 

86.4 Let (X% .w, u) be a positive measure space: Prove thatif 4 ¢.g forn=1,2,..., then 


WY 4a) < 3 wan) 
n=1 as 


(It is not assumed that the sequence {A,} is pairwise disjoint.) 

86.5 Let X be a set. Let {_w,} be a collection of o-algebras in X. Prove that a.g, is a o-algebra in 
X. Give an example to show that the union of o-algebras need not be a o-algebra. 

86.6 Prove that the sum >=, ,(4,) which appears in Definition 86.2 is independent of the order in 
which the family of sets {A,} is indexed. 

86.7 Let X bea set. When is the family of all countable subsets of X a o-algebra? 

86.8 If (X, Ug, ju) 1s a measure space such that, whenever 4 c B, Be .#, and u(B) = 0, we have 
Ace ff, We call (X, yy, ) a complete measure space. 

Let (X, .#, ) be an arbitrary measure space. Let [—oo, wo] = [—2.1) U @ U (0, w] be the 
collection of all sets su 4, where se.y and 4 c 8, where ge.g and u(B) = 0. Define % on zonz# by 
WS v A) = w(S)- 

(a) Prove that 71s well defined, that is, that the value of 7 does not depend on the 
representation su 4. 
(b) Prove that 7 1s a o-algebra in_X. 
(c) Prove that 71s a measure on 7. 
(d) Prove that cx, .%, @ 1S a complete measure space. 
86.9 Let w be a o-algebra ina setX. 
(a) Letge x. Prove that 


Me = {AN E| Ae uM} 


is a o-algebra in EL. We call .w, a relative o-algebra. 
(b) Suppose (X, %, 4) iS a positive measure space and let .w, = {4n E| Ac .#}. Prove that 
(E, MY), where 4(4) = (An E) 18 a positive measure space. We call (E, .g, y) a relative 
measure space. 


87. Measurable Functions 


Definition 87.1 A function / from a set_X, with a o-algebra yw, into [—00, 00] is called an extended real 
measurable function on X with respect to wg if ¢-(Vv)e.# for every open set V < [—on, oo]. 

A function f which satisfies Definition 87.1 will be referred to as .g-measurable or just 
measurable if vg is clear from the context. 


Example. Let X be any set and .w = w(X). Then every function f: X¥ — [-oc, «] is measurable, 
since ¢-1(v}« ax) for every V open in [— ©, 00]. We now wish to obtain some statements equivalent 


to Definition 87.1. 


Theorem 87.2 Let X be a set and wy be a o-algebra in_X and let f be a function from_X into [— ~, oo]. 
Then the following are equivalent. 


(i) fis measurable. 


(ii) {x|fG@) > a} for every geR. 

(ill) {x | f(x) < a} ©. for every aeR 
(iv) {x|ftx) < a} ©. for every eR. 
(Vv) {x|fG) = a} e.m for every aeR. 


Proof. (1) implies (11) by Definition 87.1. 
(11) implies (111). Assume (11) holds. Then for any geg 


x |/0) <a} = x\6 {x Lf) > a i} 


Since {x| f(x) > a — Ifn}e.@ for eachn = 1, 2,..., then 2, {x|f) > a— 1fn}e.#- Therefore, 
X\(\ge1 {| f@) > a — In} 4, which gives (iil). 

(i11) implies (iv). Assume (111) holds. Then for any ger, {x | f(x) = a} = X\U2, {xf < a - Vn} 
which is in gw since each yj f(x) <a@+ i/n}ew by (ill), and .w is closed under countable 
intersections. 

(iv) implies (v). Assume (iv) holds. Then for any geRg which is in .w since 
{x |f(@) = a} = X21 ix 1M) < a - Un} by (iv), and .w is closed under countable unions and 
complementation in_X. 

(v) implies (1). Assume (v) holds. Let V be an open set in [— 2%, 0]. Then V can be written 
uniquely as ()@, A,, where A, A; = @ for eachi #/, and A, is of the form (a,, ,), (4,, ©] or [~ ©, 
a,) for some q,, b, eR. (These are the open intervals of R.) Therefore ¢-1(v) = (J2, f-1(4,). But -w is 
closed under countable unions; so to show fis measurable, it is sufficient to show that f-1(4) e.# for 
all the open intervals A of 7. We handle each type of open interval separately: 

l. f-@a, cof) = 2%, {x | fA) = a + In} eM for any aeR. 
f-*([-«, a) = X\{x| fd = a} « # for any aeR. 
f(a, b)) = f *(-—2, 5) nf *((a, oof) by 1 and 2 for any g, be R. 
f7(-—«, «)) = (J2,f-1(—2a, mn) € & by 3. by 3. 
f7(-, a) = f-((—00, a) nf 7 '"(— 0, «)) e # by 2 and 4 for any a, beR. 
f~q- 0, a)) = f~4{—oo, a)) nf q( 00, 00) = “bY 1 and 4 for any a, be R. 


Sor. 


Items 1 to 6 cover all cases. gy 

We wish to show that the class of measurable functions on X with respect to .w is closed under 
certain important operations. In the following theorems it is understood that X is a set and wy 1s a o- 
algebra in xX. 


Lemma 87.3 If F: R — R is continuous and /: X — R is measurable, then F' ° fis measurable. 


Proof. Let U be an open subset of R. Now F''(U) is open since F' is continuous. Since f is 
measurable ¢-1(F-1(u)) ew. NOW (Fo fy-"(U) = fF") 6 Ms; hence F'° fis measurable. my 


Theorem 87.4 If fis a real-valued measurable function and c is a real number, then the functions cf, 
f°, and |f[ are measurable. If further f(x) 4 0 for £432 ,, then 1/fis measurable. 


Proof. The conclusions follow from Lemma 87.3 by taking F(x) successively to be cx, x’, |x|, and 
l/x. 


Theorem 87.5 Let {£32 , be any sequence of measurable functions on_X. For each xe x define 
g(x) = lub {f,) | nm = 1, 2,...} 
h(x) = lim sup f,{x) 
k(x) = glb {7,(x) | # = 1, 2,...} 
{(x) = lim inf f(x) 
Then g, h, k, and / are measurable functions on_X. 
Proof. First note that each of the above functions is well defined for each 
{x | g(x) > a} = U {x| f(x) > abe 


{x| A(x) = a} = 0) U {x lf, >a 4 e .¢ and that each function takes _X into [— ©, oo]. 


tf RG <a U GILG) <aew 


For each ge Rg we have 
(1a) > a} = Y (1G) > a}ew 


{x | A) 2 a} = 0) U jxLAa) > a- thew 


2 


{x |] k(x) < a} = () {x |f,@) < abe 


and {x | I(x) s a} = () U 1A) <a+sbed 


Therefore by Theorem 87.2, g, h, kA, and / are each measurable on X. 


Corollary 87.6 


(i) Iffand g are measurable, then max {f, g} and min {f; g} are measurable. 
(41) For any function f define 


f* =max{f,0} ff" = —min{f, 0} 


If fis measurable, then f* and f are measurable. 
(111) The pointwise limit of a convergent sequence of measurable functions is measurable. 
The functions f* and f defined above will be used extensively in the next section. We note that f= 
f—f and fl=f +f. 
After proving the following lemma, we will prove that sums and products of measurable functions 
are measurable. 


Lemma 87.7 If f and g are measurable, then {x | f(x) < g{x)}—e.#. 


Proof. lf A. = {x |fix) <r} and B.= {x | g(x) >r}, then 4,, B, A, n Be. Now 


{x | f(%) < g(x)} = YU (4, 1 B,) € 


since .w 1s closed under countable unions. gy 
Theorem 87.8 If f and g are real-valued measurable functions, then f+ g and fg are measurable. 


Proof. We note that if a is a real number, then because of the equation 
{x|a— g(x) <r} = {x|a—r < g(x)} 
a — gis measurable. Thus, for any number a, by Lemma 87.7, 
{x1 f(x) + g(x) < a} = {x [f@) <a - g@)jped 


Therefore f + g is measurable. 
By Theorem 87.4 and the result above, (f+ g)” and (f— g)? are measurable. Thus 


fo=3tI+ oY -V- 97) 


is measurable. gy 
We now investigate a special class of functions onX. 


Definition 87.9 A simple function 1s a function with finite range. 
We shall be especially interested in real-valued, simple measurable functions on_X. Suppose {c,, . . 
,c,} 18 the set of distinct elements of the range of a real-valued, simple measurable function s on_X. 
Let A,=s'(c,) fori=1,...,n. Then {A,} is a pairwise disjoint family of sets in ,w whose union is X 
and s may be written 


n 
s= p? CA, 
=1 


Figure 87.1 


Example. Let ¥ = R, A, = 0, 1], A, = {2}, A; = [-3, -4) andc, =1, c, = 6, andc, =z. Then 


3 
a oy Cia, = 1+Xp0,17 + 6- X¢2) + RX-3,-4) 


, 
il 


is a simple function. (See Figure 87.1.) 


Theorem 87.10 If fis any measurable function from_X into [0, 0], then there exists a sequence {s5}=, 
of simple measurable functions such that 


O<5s, 55,55, 5:-- 
and lim s,(x) = f(x) for allxe XY 
Proof. Suppose f: X — [0, ©] is measurable. For eachn = 1, 2, . . . define the sets 
kK k+l 
Ary = 5*([ 5 |) for ka 2 ne = 


and 4, = f-"({n, 2]) 


Then clearly for each n = 1, 2, . «© . 5) Ay Aym ANd  Aagye- +, Azmi 
nzr-t Ce ee . 
5, = > st te +4,  forn = 1,2,3,...are mutually disjoint. By Theorem 87.2 each of these sets 1s 
aes ni n | at Bnd 
in yg. Define 
nzn=t k 
S= Yo ata. t+ 2X4 forn = 1,2,3,... 
x= 3 n n 


It is easy to show that each s, is a measurable simple function (see Exercise 87.2). By construction 0 
$5,S58,55,5°°°. 

We wish to show lim,_,.. s(x) =/(x) for each xe x. 
cass 1. Suppose f(x) = 0. 
Since xe A, forn=1,2,..., 

lim s,(x) = lim ny, (x) = lim x = © = f(x) 

cass 2. Suppose f(x) = 0. 
Now xeAo,, forn=1,2,...;s80 


0 ; 
lim s,(x) = lim or £Ao xX) = lim 0 = 0 = f(x) 


navw 


cass 3. Suppose f(x) € (0, co). Then there exists an integer N such that f(x) < N. By construction for all n 
> N, x is in exactly one A,,, for some k= 0, 1,..., 2" — 1 and also 


k I 
0<f%)-T<z 


But 5,(x) = 


k Kk 
Phy) = Fa 


so for eachn > N we have 0 < f(x) — s(x) < 1/2”. It follows that 


lim s,(x) = f() 


By cases 1, 2, and 3, we have lim, |, s(x) =/(x) forallxex. m 


Exercises 


In these exercises, unless specified otherwise, X is a set and w is a o-algebra inX. 


87.1 
87.2 


87.3 


87.4 


87.5 


87.6 


87.7 


87.8 


87.9 


Deduce Corollary 87.6 from Theorem 87.5. 

Prove that iff: X — [0, ©] is bounded and measurable, then the sequence {s,}~ , in Theorem 
87.10 converges uniformly to f- 

Let f be a real-valued function on_X. Prove that fis a measurable function if and only if for 
each closed set cc R, f-(C) ¢.#. Show that this statement remains valid if closed is replaced 
by compact. 

Let fbe a real-valued measurable function and c be a real number. Prove that cf, | f|, and 1/f 
(provided f(x) # 0) are measurable directly from Theorem 87.2. 

Let X be any set and w = {g, X}. Prove that the class of measurable functions is exactly those 
functions which are constant on_X. 

Let X be a set and w be a o-algebra in X. 

(a) Prove that a simple function s = y4., ¢,x4, on -X, where the {c,} are distinct and not zero, 

is measurable with respect to -w if and only if A,, A,,..., A, are all elements of yw. 

(b) Prove that the sum of any two simple functions is a simple function. 

Let X be a set, let vw be a o-algebra 1n_X, and let f be a function from_X into [—, oo]. Prove 
that the following are equivalent. 

(a) fis measurable. 

(b) {x| f(x) > r} © for every re Q- 

(C) {x|fG) <r} ©. for every reQ- 

(d) {| SQ) < rhe Mm for every reQ- 

(©) {x|f@) =r} eM for every reQ 

Let X be a set and yw be a o-algebra in X. Let ¢¢}2 , be a sequence of measurable real-valued 
functions on_X. Prove that the set 4 = {xe X| (f(x) }2%, converges in R} Converges in R} is in yw. 

Let f and g be measurable finite-valued functions on_X with g(x) # 0 for all x ex. Prove that 


f/g is measurable. 


87.10 Let fand g be measurable functions on_X. Prove that the sets 


{x| f() < g(x)} and {x| f(x} = g(x)} 


are measurable. 


87.11 Prove that if fis a real-valued measurable function, so is |/°, c > 0. 
87.12 Let w be a o-algebra ina set _X and let Few. Let w, be the relative o-algebra (see Exercise 


86.9). 

(a) Let fi X — [-co, «] be ,g-measurable. 
Prove that fE is .gw,-measurable. 

(b) Letf: E — [-co, «] be w,-measurable. 


Define g(x) ={/ ao . 


Prove that g is ,w-measurable. 
87.13 ~ Prove the following theorem due to F. Riesz. Let (X, .g, 12) be a measure space and let f and 
{f,} be measurable functions on_X such that for every 6 > 0, 


lim wC{x | |/@) — fG)| 2 6) = 0 


Then there exists s¢.g with uw(S) = 0 and a subsequence ,s) = 0 such that ,¢,,} for every g + 9. 
87.14 “Let (X, w, ) be a measure space with w(X) < 0. Let {f'} be a sequence of measurable 
functions on_X which converges to f on_X. Prove that for any ¢ > 0, there exists a set e.g with 
LE) < such that {f,} converges to f uniformly on X\E. 


88. Integration on Positive Measure Spaces 


We now develop a theory of integration on any positive measure space (X, yw, ). The simplicity of 
the development and the power of the results are the real beauty of this part of mathematics. 

In the following X is a set, w 1s a o-algebra in_X, and yu is a positive measure on yw. 

We begin by defining the integral of a nonnegative simple measurable function on_X. 


Definition 88.1 Let s be a nonnegative simple measurable function in 5 = Y7., cx4 Where 4 < y and 
c,>0fori=1,...,n. We define the integral of s over X with respect to yu to be 


[sa = 3 cul 
xX i=1 


Notice that Js du>0. 
Consider (P, g(P), “), where “ is counting measure. Suppose s = {s,} is a nonnegative simple 
function on P. If s = 7. ex, where c,;> 0 fori=1,...,m, 


mt 


[sda Zemad = 5 sy 
This sum is finite if and only if for some N, s, = 0 for n = N. 

The reasoning for our choice of the number I. s du as our integral of s over X is clear, since we are 
averaging s over the set XY and weighing the various disjoint subsets of X, where s takes on different 
values, by means of our measure ju. We used a similar method when integrating step functions over an 
interval [a, 6] with the Riemann integral. 

We use the following definition to extend Definition 88.2 to the class of all nonnegative measurable 
functions or X. 


Definition 88.2 Let f/be a nonnegative extended real-valued function on_X. We define the integral of f 


over X with respect to 1 to be 
| fdu = sup | s du|s iS a simple measurable function on X with 0 <5 < st 
xX Xx 


Since 0 = i 0 du is in the set on the right, i f du is well defined. It is easily verified (Exercise 88.1) 


that Definitions 88.1 and 88.2 are consistent. 
Returning again to (P, w(P), “), where mw is counting measure, suppose {a,} 1s a nonnegative 


sequence. First, suppose ¥ a, = oo. Let M be any number. Choose N such that y < p¥_, g,. Define 


a, n=N 
S, = 


Then s is a simple function, s <a; so 


N 
M< ¥a=| sas a dy. 
P P 


It follows that Je adn =.0.= Eau 1 pq: 
Next, suppose y*, a, < oo. If {s,}. If {s,} 


a) irs) 
[sa = 7 mh a ee 
P n=1 n=1 


is a simple function with 0 < s <a, then 


It follows that 
(88.1) 


| adu< > a, 
P n=1 
Let > 0. Choose N such that >"... a, < e- Let 


Then s is a simple function, 0 < s <a, and 


i. 9) N fra) 
Laster 2. & 
n=1 nt 


1 n=Nt+1 


1 


< | sd tes | adute 
P P 


Since $2, a, < fps du + « for every e > 0, it follows that 


This inequality combined with (88.1) shows that 
ee | @ du 
n= i Pr 


Definition 88.3 Let f be a measurable function on X. Let © and f be defined as in Corollary 87.6. 
Since f* and f are measurable, nonnegative functions, J yt du and J yJ du are defined. If at least one 
of the numbers J yt dor J yt dis finite, we define the integral of f over X with respect to yu to be 


| fam | fae | i 4 


If both J, f* du and J, f° du are «, we say that J, fdu is not defined. If both J, f° du and J, f du are 
finite, then | J du is finite, and in this case we say that fis Lebesgue integrable on X with respect to 
u, and we let y(X, .w, ) denote the set of all such f. 

It is easily verified (Exercise 88.2) that Definitions 88.2 and 88.3 are consistent. 

Again consider (P, g(P), 1), where “ is counting measure. Let {a,} be an arbitrary sequence, then 
a* =p, anda, = g,, where p, and g, are defined in Section 26. The proof of Theorem 26.2 shows 
that $",p, and $.g, converge if and only if $"@,4, converges absolutely. Since 


Seat du= 52, p, Md fram du= D219,» it follows that {a,}e.2(P, A(P), ») if and only if 
@ , a, converges absolutely, and in this case we have 


| adu= >) a, 
P n=1 


Theorem 88.4 


G) If f ge LX, , p) and f(x) < g(x) for xe x, then 
| fds | g du 
x x 
(ii) Iffis measurable, u(X) <0, and for some g,heR We have a <f(x) <b for xe x, then 
aX) = | fae < ba(X) 


(iii) Iff'is measurable and bounded on_X and if u(X) < ©, then fe YX, M, y)- 
(iv) If fe (xX, mM, wy andcer, then efe Y(X, M, ys) and 


| efdu=c | fdp 
x x 
(v) Ifm(X) =0, then every measurable function fon_X is in y(X, wy, “) and 
{ fdp=O0 
x 


Proof. We prove (1) only. The other parts are proved similarly and are left as exercises (see 
Exercise 88.3). 

Suppose 0 < f(x) < g(x) for xe x. Ifs is a measurable simple function withO <s <f, then also 0 <s 
< g; hence 


| du < | g du 
x x 


Thus J | g du is an upper bound for the set of numbers 
| s du With 0 <s <f It follows that | oe { ad 
xX x x 


Let f, ge P(X, M, py) With f(x) < g(x) for xe x. It is easily verified that / < g* and f > g. By the 
special case above 


| fr dus | g* du | fo dee | g” dp 

x Sg xX xX 

Therefore 
[fam | rede | pode s | a* du — | o- du = | gdu 
xX x bX ¢ xX 4 Xx 


If £ ge L(X, M, ), We sometimes wish to integrate fon a set Fe .g. This integral, denoted i, t 
du, is defined to be J Xz A. It is easy to show (see Exercise 88.4) that if J J dis defined, then also 
|, f%_ du is defined so that J, f du is defined for each set Fe .f. 

Our immediate goal is to prove the Lebesgue monotone convergence theorem (Theorem 88.6). 

The proofs of other important theorems such as the linearity of the integral (Theorem 88.11) and 
other powerful convergence theorems (Theorems 88.13, 88.14, and 88.15) will depend on Theorem 
88.6. First we must establish a lemma. 


Lemma 88.5 Let s be a nonnegative measurable simple function. Let {E,,} be a sequence of sets in w 
withE, c E,,,forn=1,2...and Lee E, = x. Then 


im | du = | s du 
nro JE, x 


Proof. We show that y(£) = J 5 du defines a positive measure on w. Since (2) = 0, we need only 


verify the countable additivity of y. 
Suppose 5 = DL, ¢iyx4, For Fe .W we have 


| sd = | Ste du = | & Cita) dy 
E x x \i=1 


= | (s Cita) du = » cplA; nm £) 
X \t=1 i=i 


Let {£;} be a pairwise disjoint sequence in y. Letting F = | )#%, E,, we have 


ue) =| s du =. egy B) 
“Et a) 


ll 


Ms a 


| 
ies 
Sad er 
r 
2 _ Ms 
$ ¢€ 
~-~ 
ll Co 
Ms | 
Ass) 
tos le 
en cameos 
zo 


= 
It 
_ 


Thus y is a positive measure on y. 
Let {£,} be a sequence in with FE, c E,,, forn = 1, 2,...and (Jz, z,=¥. By Theorem 
86.5(v), 


lim | sdu = lim A(E,) = (0 E,) = A(X) = | sdu wm 
En n+ n=1 x 


a> 20 


Theorem 88.6 (Lebesgue Monotone Convergence Theorem) Let {f,} be a sequence of 
nonnegative measurable functions on X such that f(x) <f,.,(x) forn = 1, 2,... and xe x. Let f(x) = 
lim... f,(x). Then fis measurable on X and 


im | f, du = | fai 


am © 


Proof. By Corollary 87.6(i11), fis measurable on_X. Since 
| fri du < | Fn+s Ue 
x x 


lim... J,.f, du exists in [0, 00]. Denote this limit by L. 
Since f, <fforn=1,2,..., we have J, f,< J, f for n =1,2,....Lettingn — ~, we obtain 


a |. f (88.2) 


Let ¢e (0, 1) and let s be a simple measurable function with 0 < s <f. Set 
E, = {xe X| f(x) = t(2)} 


Then E, ¢ £,,,forn=1,2,...and Fe .g. By Lemma 88.5, 


lim | ts du = | ts du 
Ey z 


aim 


Now | fade = | fed = | ts dj 
Xx En 


nm 


and letting n — 00, we obtain 


L= lim | fa > tim | is dy = | isdx = 1 | sd 
x En x x 


naw noo 


Letting ¢ > 1, we obtain L > J ys du. By the definition of J yt du, we have 


Le | fdu 


which, together with inequality (88.2), establishes the theorem. 

As an application of Theorem 88.6., let {a,,} be a nonnegative double sequence. Let 
f,(m) = Xf. 4 a,,;, Consider the measure space (P, g(P), 4), where is counting measure. Then {f,} 
is an increasing sequence of non-negative functions on P. Also, f(m) = lim,.., fm) = 0% ay; BY 
Theorem 88.6., 


fie le Pie I dp (88.3) 


no? oO 


Now fp fd = D2-1 (L21 a,)- Also, 


We earlier established this result as Lemma 29.3. 
Before establishing our next major result, which is essentially a generalization of Lemma 88.5, we 
must establish a special case of the linearity of the integral. 


Lemma 88.7 If f and g are nonnegative measurable functions on_X, then 
[Garde | tant | oa 
x x x 
Proof. First suppose f and g are measurable simple functions. We may write 
= xy GiXA; g= » 5 jXa, 
i=1 j=l 


where ‘4 and ={B} are pairwise disjoint and wA;= X= UB; Then 


f+ 9 = Dlr Dji1 G@ + 4))xa,r8, Therefore 
| f+ ade= 3 ¥ (a+ balan B) 
i=1 j= 


4% WA OB) + ¥ by Yar B) 


a = i nhs 


ayhA) + ¥ b(B) = | fan + | 9 a 


~ 


Now suppose that f and g are nonnegative measurable functions on X. By Theorem 87.10 there 
exist sequences of simple measurable functions, 0<s,<s,<°-+-:andO<¢,<t,<- °° such that 


lim... 8,(«) =/(x) and lim, _.,, t,(¢) = g(x) for all xe x. Clearly lim, _,.. (s, + ¢,)(x) =f{(x) + g(x) for all 
xe x; 80 by Theorem 88.6. and the special case above 
2, (a, + 5;)u(A;j m B;) 


f=l 


J a; 2, WA; 0 B;) + » b; x H(A; 7 B;) 


sty 


~ 
I 
-_ 


| f+ ade = 


Ms 


t 


= 3 amt) + va sll = | fae + {9 du 


Theorem 88.8 Let fbe a nonnegative measurable function on_X. Then 


{ (f+ g)du = \ lim (s, + ¢,) de = lim | (8, + £,) du 
X n+ nwo JX 


= lim (| 5, dt + | ind = lim | s, 44 + lim | t, du 
x x na n-a JX 


ao 


= | (lim s,) due + { (lim ¢,) du = | fd + { gdu si 
X asrw X avw x x 


defines a positive measure on y. 
If AZ) = | f dp defines a countably additive set function on yw. 
E 


Proof. Let f be a nonnegative measurable function on X. Since »(2) = 0, we need only verify the 
countable additivity of y. 
Let {£;} be a pairwise disjoint sequence in w and let F = | J*@, £;. Define 


f= ¥ fice 


Then {f,} 1s a sequence of nonnegative measurable functions on X such that f,<f,,, forn=1,2,.... 
By Theorem 88.6., since lim,_,... =f, =/Vn 


tim | fod = | fas de 
x 4 


a~o 


By Lemma 88.7 
[fede =] (S see.) = 3 | tree = S108) 


Thus 4(£) = \, Sis du = lim by ME) = > AE;) 


n+ mizi 


If fe LX, M, i), one shows that y(£) = aia f du defines a countably additive set function on w by 
applying the result just established to f and f. 

With modest additional hypotheses, a converse of Theorem 88.8 can be proved. This converse is a 
special case of a more general result known as the Lebesgue-Radon-Nikodym Theorem (see Hewitt 
and Stromberg, 1965, p. 315). One can show that if and y are positive measures on the o-algebra w 
satisfying “(X) < 0 and y(X) < co and further uw(£) = 0 implies y(£) = 0, then there exists a nonnegative 
measurable function f on_X such that 


AE) = [fa 


for every Fe ff. 
In Section 57 we said that a property P holds almost everywhere if the set of points on the line 


where P does not hold is of measure zero. We now generalize this definition to an arbitrary measure 
space. 


Definition 88.9 Ifa property P holds for every x € F\4 and if u(A) = 0 (where £, 4 € .#, of course), 
then we say that P holds for almost all x ¢ — with respect to wu or that P holds u-almost everywhere on 
E or that P holds y-a.e. on E. 

An important example is given by the next theorem. 


Theorem 88.10 If £ g e L(X, A, p) and f= g w-a.e. on_X, then 


| fu = (9a 


Proof. Let 
B= {xe X| f(x) # 9} 


By definition, u(E) = 0. Now 


| fay = | gd [fas 0= | adn 
X\E X\E E E 


Therefore, by Theorem 88.8, 


| fae = | san + | fu = | gd+\ ode | oa F 4 
x X\E E X\E E x 


We next show that the integral is linear. Although it may appear that this fact should follow 
immediately from the definition it does not. Our proof depends directly on Theorem 88.4 and 
indirectly on Theorems 87.10 and 88.6. 


Theorem 88.11 If £ g e CX, A, yp) then f+ g e P(X, .M, ys) and 
[G+ adu=| fae | oan 
zx x x 
Proof. This result has been established (Lemma 88.7) for fand g non-negative. Suppose f> 0 and g 


< 0. Let A= {xeX|(f + 9X = 0} and B = {xe X|(f + gx) < 0}. Then f + g, f, and —g are 
nonnegative on A. Therefore, by Theorem 88.4(iv) and Lemma 88.7, 


[ sue=| vt ae+ | com=[ tad | ode oe 
Similarly, -(f+ g), f, and —g are nonnegative on B. So 

[ ordu=| tans | (r+ 0) a 

B B B 

or [ adu= | (f+ ade | ram (88.5) 


Adding equations (88.4) and (88.5), we get 
[f+ du= | fades | oa 
x * x 


Now let f and g be any functions in ¢(X, w, “). Thenf=/f —f and g =g"-g with/’, /, 2, and 
g ing(X, .g, “). By the above result and Lemma 88.7 


| Of + a) du = | ie EP =0F) 
xX 7: 


. Kea +9") du + \. ~(f7 + 97) dp 


= | + 9") dp — [or + 9°) dp 

st du + | at du—| pode { om ay 

ft dut I, —f dwt [a du + | 9° de 
=| ot -F m+ | ot om 
[tte fe 


Theorem 88.11 together with Theorem 88.4(iv) shows that y(X, w, “) 1s a real vector space and 
that 


fo | fa 


is a linear functional on ¥(X, -y, /). 


Theorem 88.12 fe Y(X, M, js) if and only if || e ¥(x, M, p)- In this case 


I < | iside 


Proof. Suppose fe P(X, #,)- By definition ft, f- 6 Y(X,.m,y) By Theorem 88.11, 
Ifl=ft +f7 6 2X, AM, wf fle 2X, Mm, w, since f <| fi iS du sly Vidu<~; 80 ¢* ¢ Y(X,.M, p) 
. Similarly, f- e¢ Y(X, M, py). Therefore fe YY, M, )- 

Now |I, fdul=c J, f du for c = 1 or c=-1. Since cf < |fh, |, fdu| =cl,fdu=,cfdu<Jy du. mw 

We next develop some powerful convergence theorems. That such theorems can be proved is a 
demonstration of the importance and usefulness of the Lebesgue integral. 


Theorem 88.13 If { f,}%, 1s a sequence of nonnegative measurable functions and f(x) = y@, f(x) 
for all fx) = 3.4 42) then 


|, fe 7 z [J a 


Proof. The partial sums s(x) = y"_, f(x) form an increasing sequence of nonnegative measurable 
functions; so by Theorems 88.6 and 88.7 we have 


| fa | lim su du = lim | sa du = tim | yf, de 
X », @ 


XK m?0 m> oa mao J X n=1 


=lim 5 | fod -¥ | fad 


mac a=i1 


Theorem 88.14 (Fatou's Lemma) If { £}” , is a sequence of nonnegative measurable functions, then 


| (lim inf f,) du < been n inf | f,du 


X no 


Proof. By Theorem 87.5, lim inf, ,,. f, 1s measurable. For n = 1, 2,...and for each xe x, let 


n—oo 


P(X) = glb {f,(x) |i = 7} 
Then p, is measurable, 0 <p, <p, <°-:- on X, p,(x) < f(x) for all xe x, and lim, p(x) = lim 
inf, f(x) for all xe x. Using Theorem 88.10 and the above equations, we get 


[ lim inf f, du = | lim p, du = lim | P, qe = lim int | fd 5 
X n+ wo X nto mao JX n+ co 


Now we state and prove one of the most powerful theorems of Lebesgue integration theory. 


Theorem 88.15 (Lebesgue's Dominated Convergence Theorem) Let {f}%, be a sequence of 
measurable functions such that lim, f,() exists for all £ g e YX, M, p). If there exists a function 
ge L£(X, M, w) Such that 


\f.Ax)| < g(x) = for allxe Xandalln =1,2,... 


then lim, Jf, du=Jylim,_.., f, du. 


Proof. Set f(x) = lim, ,. f(x) for xe x. Since |f(x)| < g(x) for xe x andn =1,2,..., we have |f(x)| 
< g(x). By Theorem 88.4(1) iA < is g. Thus | |e Y(X, M, p). By Theorem 88.12 fe (Xx, M, w) 
also. Similarly, ¢ ¢ P(X, .m, wp) forn=1,2,.... 
Now f, + g = 0; so we may apply Fatou's lemma to obtain 


[, lim inf (f, + g) du =< tim inf | (f, + 9) dp 


But lim inf (4, + g) = lim f, + ¢ 


n> oo io 


so we have ime (lim f, + g)du < lim int(( f,dut | 9 du) 
no pt x 


This gives | lim f, du < lim int [ aia 
Since g — ft =0 en_X, we seein a imilar way that 


(88.6) 


|. (g — lim f,) du < lim int (| (9 -—Sf,) dy) 
n> co n= xX 


that — i um inf{ — 
so tha | im J) du < lim in ( iF: an) (88.7) 


io 


Therefore | (lim f,) du = lim sup | Sf, du 
Equations ¢%8:6)eand (88.7}eembin¢gAo give 


lim sup | ide < | lim f, du < lim int | f 
nto x X no no 


which implies J, lim, .,, f,du=lim,_. Jf, du. m= 
We conclude this section by proving the following special result. 


Theorem 88.16 Suppose fis measurable and f(x) => 0 for all xe y. If], f du = 0, then f= 0 w-a.e. on 
X. 


Proof. If suffices to show that for the set 4 = {xe X| f(x) # 0}, we have u(A) = 0. For then if 
B= {xe X| f(x) = 0}, we would have B’= A; so f= 0 would be true “-almost everywhere on X. 

Let 4, = {xe X| f(x) > In} forn=1,2,3,.... Each 4 e.g since fis measurable. Suppose /u(4,) 
> 0, then 


J 
[faa | sane | fdue | pause 

x An’ An An! nt 
But f(x) 2 0 for all xe x implies f, fdu=O so we have fyfdu>f, (/ndp=(1/n) pA, > 0, a 
contradiction. Thus w(4,) = 0 for nm = 1, 2, . . . . Now A=(J", A, so 


0 < pA) = H(U2, A) < 52, 2A, = 0 and therefore (A) =0. 
Exercises 


In these exercises, unless specified otherwise, (X, -y, //) 1S a positive measure space. 

88.1 Give the details of the argument that Definitions 88.1 and 88.2 are consistent for nonnegative 
simple measurable functions. 

88.2 Show that Definitions 88.2 and 88.3 are consistent for nonnegative measurable functions. 

88.3. Prove Theorem 88.4, parts (11), (iii), (iv), and (v). 

88.4 Prove that if] x dis defined, then also J S%,; du is defined for each F e.g. Prove also that if 
fe 2(X, M, wo, then fy, 2(X, m, ) for each Fe. 

88.5 Let (X, gw, “) be a positive measure space. Let Fey. Let (LE, wy), where 1(4) = (Ac E), 
be the relative measure space (see Exercise 86.9). 
(a) Let fe v(x, .w,. Prove that sjze (£, m,;, 4) and 


| fleaa = [ fixe du 


(b) Let a = FO : a Define 


[9d = [922d = {fu 
Prove that g ce Y(X, ., yw) and 
[9d = [ged = [fe 


88.6 Let (X, w, “) be a positive measure space with w(X) < oo. Suppose lim, f(x) = f(x) for 
every xe x and for some MW, |f (x)|< M for n = 1, 2,...and for every xe x. Prove that 


in J, fade = [Fe 


88.7 Show that Theorems 88.6, 88.13, and 88.15 remain valid if for all x is replaced by for 
almost all x with respect [. 

88.8 Let (X, gw, “) be any positive measure space. Suppose fe (x, .#, ). Prove that f(x) must be 
finite u-almost everywhere on_X. 

88.9 Let X= {1, 2, 3,4,5}, =p, and uw be counting measure. Let FE = {1, 2} and define f, = 
x, \fn is odd, f, = 1 — 7, 1fn is even. What is the relevance of this example to Fatou's lemma? 

88.10 Let (X, vg, “) be any positive measure space. Suppose “u(X) < « and { f,}" , is a sequence 
of bounded real measurable functions on_X and f, — funiformly on_X. Prove that 


lim fidu = | fdu 
n~o JX x 


88.11 Show that the hypothesis “w(X) < ©” cannot be omitted from Exercise 88.10. 
88.12 Let (X, yw, us) be any positive measure space. Suppose fe ¥(x, .#, - Prove that for every ¢ > 
0 there exists a 6 > 0 such that 


J \f|du<e whenever #(E) < 6 and Ee. 
E 


This property is sometimes referred to as the uniform continuity of the integral. 

88.13 Let (X, gw, “) be any positive measure space. Suppose f,: X — [0, 00] is measurable for n = 
12,...sff2h2A2° °° 20;lim,_... £() =x) for every x in -X; and £, e (x, .#, 4). Prove 
that 


im, | tote J, Fen 


and show that this conclusion may fail if the hypothesis “/, « g(x, .#, »)” 1S omitted. 
88.14 Suppose fis measurable and f(x) = 0 for almost all +e x with respect to w. Prove that 
Jaf du = 0. 
88.15 Suppose {/,} is a sequence of measurable functions, m=, | f,¢)| converges for all xe x, and 


® | fCd| © £(X, #, Prove that »@ , f(x) converges for all xe xn@, f00) © Y(X, M, w and 


88.16 Consider (P, a(P), ), where yu is counting measure. Let y be any positive measure on g(P). 
Prove that there exists a nonnegative function f on P such that 


ME) =| fay 
for every Ee AP). 
89. Lebesgue Measure on R 


We have developed an integral for certain measurable functions on any measure space (X, yw, 1). We 
have shown that some very powerful integral-limit theorems always hold for this integral (Theorems 
88.6, 88.13, 88.14, 88.15). What does this have to do with the Riemann integral? The satisfying fact 
is that there is a o-algebra .w on [a, b| and a positive measure m on -w such that for a// Riemann 
integrable functions f, we have fe £({a, 6], ,m) and 


| fdm = [ fx) dx 
fa.) a 


However, much more will be true. There will be many more functions than the Riemann integrable 
functions which we can integrate. 
For example, returning to the function 


| for x a rational number in [0, 1] 


fe) = ‘0 for all other x € (0, 1] 


discussed in the introduction to this chapter, we will find that we can integrate f- Recall that f was the 
pointwise limit of the functions 


1 forx = 4a,i=—1,2,...,” 


fx) = } 
0 for all other x € [0, 1] 


where {a,} is the set of rational numbers in [0, 1]. Since each function f, is m-measurable, Theorem 
88.6 tells us fis m-measurable and 


1 
0 = lim | f,Ax) dx = lim | t,am 
n>a JO (0,1) 


nm co 


- | (lim fd = | fdm 
[0,13 


[0,1] wo 


Since fis not Riemann integrable, we see that we have extended the class of integrable functions 


and obtained a much more useful class of integrable functions. 

We will actually construct a o-algebra of R and a measure m on this o-algebra such that, in a very 
natural way, we may restrict m and the o-algebra to any closed interval [a, b] and get the desired 
results. 


Definition 89.1 Let U be any nonempty open subset of R. U can be written uniquely as a countable 
union of pairwise disjoint open intervals (see Exercise 39.8); so 


U=(|)i, with J, = (,, 5,).for some a,,b, ER 
neJ 


(We recall that intervals such as (1, 0) and (—o0, 0) are open in R.) As a convention we will always 


assume these open intervals to be indexed by J= {1, 2,...,} if the collection is finite or J = {1, 2, 
3,4,...} if the collection of intervals making up U 1s infinite. 
We define 
(89.1) 


m*(U) = » (5, — 4,) 


ned 


Since » — a,€[0, 0] for each yey and J is countable, there is no ambiguity in the order of the 
summation of equation (89.1). (See Theorem 29.7.) 


Examples. (a) If U = (1, 2), then J = {l1!, J, = CU, 2) = (@, 56,) and 
m*(U) = ¥ (6, — a,) = 5; —a, =2-1=1 

nel 

(b) IfV=(—, ), thenJ= {1}, J, =(—~, ©) =(a,, b,) and 

m*(V) = ¥ (6, — 4,) = 6, — a, = «© —(—m) = © 
net 
W=(—-l Dvd —414+ 9G =£2+ us: 
=(-1,)UQ-4,2+)0B-334+ 50° 

as the unique pairwise disjoint union of open intervals; so J= {1, 2, 3,...} 
with y, = (-1, 3), and J, = (n — 1/2", + 1/2") for n= 2, 3, 4,.... Therefore 


w= Za-a=G-er) ef (48)-(-9) 


= 5 = 5 | 7 


(c) W=(J2%,( — 1/2", n + 1/2"), we have 


It turns out that m" is countably additive on the collection of all open intervals of R, but 
unfortunately this collection is not a o-algebra. We now extend the definition of m* to a function on g 


(R). 


Definition 89.2 For each 5 — R we define 


m(S) = inf » m*(Z,)| where each I, is an open interval 


n=1 


or @MinRandSc |) uh 
n=1 


Notice that there is no stipulation that the J, be pairwise disjoint and also that m is a function from @ 
(R) into [0, co]. 

@(R) is a o-algebra in R and m: @(R) — [0, ©], however, m is not countably additive on g(R). 
This is the m we want; however, the o-algebra on which it is a measure lies somewhere between the 
collection of all open sets in R and the o-algebra g(R). 


Theorem 89.3 If V is open in R, then m(V) = m'(V). 


Proof. If V = 2, it is clear that m(V) = m"(V) = 0. Suppose V # 2. By Definition 89.1, ¥ = ner tn 
where the /, are pairwise disjoint open intervals and m*(v) = ¥,., m*(/,). If J 1s infinite, then clearly 
Vc (J@, 7,380 by Definition 89.2, we have 


mV) < . m*(i,) = 2 mln) = m*(V) 


ii J 1s finite; 1.¢,,./ = {1, 2,.«.5 7], let, = 2 fork > 1, Then pe (J, ¥,3 $0 by Definition 89.2, we 
have <y2 m= T! *(7) = Dery M*U,) = m*(V). Therefore 

mV) < Dorm) = Daa mE, = Liner MC) = mV) (89.2) 
mV) < m*(V) for all open V in R 
If m"(V) =, then it is clear that m"(V) = m(V). So suppose m'(V) < ©, theny = |J,.,%, with J, = (a,, 
b,) and g eR (both finite) and the /, pairwise disjoint. Now suppose {¢,}@., 1s any collection of 
open intervals or 2% such that pve Ue. ..2,- If J is. finite, it is clear that 
m*(V) = Laer (6, — %) = Thay (0, — a) < EL, m*(o,) (verify). Butif/ = {1, 2,...} we have that 


t re) 
¥ @, -— 4.) s ¥ m*o,) for? =1,2,... 
nat n=1 


Therefore m*(V) = ¥ (6, — 4,) = 3 (b, — @,) = lim > (b, — 4,) 
n=l Io n=1 


net 


s 3 m'*(a,) 


n=1 
We conclude, since m(V) is the inf of the sums 7”, m*(o,), that 
(89.3) 
m*(V) <= mV) 
Equations (89.2) and (89.3) give us that m'(V) = m(V) for all VopeninR. 


Theorem 89.4 If 4 « gm) forn=1,2,..., then 


m( A,) < ¥ m(A,) 


n=l 
Proof. By Definition 89.2, itis clear that for any sets 4 < gin R we have 


mA) =< m(B) 


Since A, < (J2, A, 1fm(A,) = © for some &, it follows that eo = m(A,) < m2 4, therefore, 


ine] 
nei 


Therefore, we assume m(A,) < 00 forn=1,2,....Lete>0. By Definition 89.2 for each positive 
integer n we may choose a covering {7/"}, of A, such that p=, m(Z) < m(A,) + 6/2". Then 
Uz, Uz, 7° 1s a countable covering of |}, 4, So by Definition 89.2, we have 


m( U) Ay) < Dy x mI) < a (m4, + 5) = y m(A,) + & 


n=] 


Since € > 0 was arbitrary, we have 


z= 


m{ U A,) < m(A,) 
We have constructed a function m: g@(R) — [0, ©] with the following properties: 
(i) m2) =0. 
(ii) m(4) < m(B)if Ac BER. 
(iil) m(U@, A,) s D2, m(A,) for any sequence {4,}” , of subsets of R. 
We now return to the abstract setting, because the development of a o-algebra on which m is 
countably additive does not depend on R, but only on the properties stated above. 


Definition 89.5 Let_X be a set. A function u from @(X) into [0, ©] is called an outer measure if 
(i) u(4) = 0. 
(11) (A) <(B) whenever 4¢ Bc X. 
(it) w(\YJ2, 4) < D2, w(A,) for all sequences {4,}” , of subsets of X. 
This last property is called the countable subadditivity of u. We note that countable additivity 
demands the pairwise disjointness of the sets involved, while countable subadditivity does not. 
The following definition is due to Caratheodory and is the key to defining a useful o-algebra on 
which w will be a positive measure. 


Definition 89.6 Let_X be a set and let « be an outer measure on g@(X). A subset S of X is said to be p- 
measurable if 


WT) = eS aT) + nS’ aT) forall Ta X 


Let .w,, denote the family of all u-measurable subsets of X. 
Since T = (Sn T)u(S' a T), it follows from the subadditivity of w that 


WT) <= OS T) + WS’ 4 T) 


Thus the equation in Definition 89.6 holds precisely when 


wT) = WS T) + BS’ 9 T) 
A subset S of X is not “-measurable if there exists a set 7 — x with 
WT) > WS 9 T) + pS‘ 9 T) 


Notice that in this case yw is not even finitely additive on the disjoint pair {$n 7, 5’ T}. It can be 
shown (see Hewitt and Stromberg, 1965) that there exists a non-m-measurable set 5 - R, where m is 
given in Definition 89.2. Thus m is not even finitely additive on g(R). Again, we see that we must 
restrict m to a o-algebra which 1s properly contained in g(R). 

We now proceed to show that w,, is a o-algebra in X and yu is a positive measure on _¥,,. 


Theorem 89.7 Every subset S of X such that u(S) = 0 is in y,,. 


Proof. Let se x and w(S) = 0. Let T be any subset of X. Then by Definition 89.5(11), since 


Sa Tc S We have 9 < ys. T) < y(S) = o> Which implies y(s q T) = 0. 
By (111) and (11) of Definition 89.5, we have 


KT) = WSO T) + WS' OT) = pS’ 9 T) = WT) 
Therefore, it follows that 
aT) = WS 0 T) + WS’ 4 T) 
SOSe.#,. ml 
Theorem 89.8 If Se.#,, then S’ e.#,,. 
Proof. Trivial. 
Theorem 89.9 If 4 and B are in yw, then n(E U F) = n(E) + w(F) 1S 11 4, 


Proof. It suffices to prove thatifgc 4npand Fc (Ans, then u(E UF) = p(E) + y(F)- 
Now F = (Fn B)u (Fn B) and Be #,; 80 


BCE) + pO) = WE) + wo B)U Fo B+) 
= p(E) + (Fn B) + (FOB) (89.4) 


Since ge 4and fp Bc 4’ and Ae M,, we have 
w(E) + uF 0 B’) + WF 0 B) = Eu (Fo B’)) + n(F 0B) (89.5) 
Again Eu (Fo B')¢ Band FABCB; SO 


MEU (F 0B) + WE 9B) = EU (Fo BYU (Fo B)) (89.6) 
= Ev F) 


Combining equations (89.4), (89.5), and (89.6) 


ME) + WF) = EU FP) © 
Lemma 89.10 Let {4,}2 , be a sequence of pairwise disjoint sets in w,. Then 


HT) = a WA, OT) + o((U, 4, a r) forall To X (89.7) 


Proof. By Definition 89.5(iii), we have yr) < 32, nT 4,) + ATO (2; 4,)), then equation 
(89.7) follows immediately. 
Therefore suppose that w(7) <0. We first show that 


u(T) = by uT OA) + u(r (0) Ay) ) for all pe P (89.8) 


We use induction on p. For p = 1, equation (89.8) becomes “(T) = w(7n A,) + p(T 7 Aj). But this 
follows since 4 « AM, Suppose that equation (89.8) is true for a positive integer p and all ye x. 


Since 4,,; ¢#,, we have 
HT) = WTO Aggy) + WTO Abas) = WT Apes) 
PB Pp t 
¥ 2, WTO Any, OA) & TO AD ( U A,) ) 
a= n=1 


The last equality follows from the inductive hypothesis applied to the set Tn A’4,. 
Now since 4, 2 A’,,, for n # p + 1, equation (89.9) can be written 


(89.9) 


u(T) ae ATA Ans 1) = Hy MT A,) = aT A Ant a) ( U Ay) ) 
= > HT 7 A,) + u(T 0 (U 4,) ) 
n=1 n=1 


which is equation (89.8) for p + 1. The sequence of numbers {u(T rn ((U)2=; 4,))}*, 1S a nonincreasing 
sequence bounded below by the number y(7' n ({)@, A,)'). Thus it has a limit, which is greater than or 


=1 


equal to 4(7'n (2, 4,)’) Taking limits in the equality (89.8), we get 
WT) = lim y H(T 7 A,) + lim u(r (U 4,) ) 
poo n=1 pow x=1 
> y wT 7 A,) + u(re (U 4,) ) 
n=1 n=1 


Since the reverse inequality has already been established, this completes the proof. 


Theorem 89.11 ,y,, is a o-algebra in X and yw is a positive measure on yw, [1.¢., (X, #,, /) 18 a 
positive measure space]. 


Proof. Let {4,}”., be any sequence of sets in _w,. Then 


UY) Ae = Ay U(A, 9 44) U(43N AZT A) Ure: 


U(A, A Ane ON AYU 


By Theorem 89.9, each set of the form &, = (4, 0 4,_,; n°++n Aj) 18 in -g,. Furthermore, the sets B, are 
pairwise disjoint. Let 7 — x. By Lemma 89.10 and the countable subadditivity of , we have 


u(T) = bd wT o B,) + u(r ° (0, 3.) ) 
s(n) +o) 


By countable subadditivity, we have 


1 ss(ro(Q,4)) +070 


and so iz) = (7 af (U B,)) a u(r ( U z,) ) 
n=1 n= 
This implies |), B, = U2, A, 1S in yw, This along with Theorem 89.8 implies that w,, is a o-algebra 


in X. Now let {g,}, be an arbitrary pairwise disjoint collection of elements of w,. We have just 
shown that (‘ech e Letting T = 2, 8, in Lemma 89.10, we have 


))-5olan(Q.m))+o((0.a) (0.9) 


= ¥ KB) + MB) = Y WB) 


a: 


)) 


Thus 4 is countably additive on the o-algebra w,, and so 4“ is a positive measure on yw. m™ 

We finally return to R and the outer measure m on g(R) (Definition 89.2). By Theorem 89.11 there 
is a o-algebra .w,, in R such that m is a positive measure on -y,,. 

We also know, by definition, that 4 ¢ .#,, if and only if m(T) = m(T 9 A) + mT co 4’) for all re x. 


Definition 89.12 _w,, is called the o-algebra of Lebesgue measurable sets in R. 
We wish to show that every open set yeR iS in .w,. However, we must first prove some 
preliminary facts about m. 


Theorem 89.13 Let T be any subset of R and let U be an open subset of R. Then 


(i) m(T)=inf {m(V)|Vis openinR and ye pf}. 
(41) m(U)=sup {m(K) | K compact in Rand xc y}. 
(iu) m(U)=sup {m(V) | Vis open and 7 1s compact in R withy - y}. 
Proof. (1) Let 
(89.10) 
m*(T) = inf {m(V)| V open and Tc V} 


By Definition 89.2 


m(T) = inf { ¥ mi) where each J, is an open interval 
m=1 


or @ and Tc () i} (89.11) 
n=1 

Suppose /, is an open interval or 2 forn=1,2,...7< (2,7. Theny = (J@, 7, is open in R and 

T c ¥. By Theorem 89.4, we have mv) = wi JS, Fs SE wll). Therefore, we have shown for every 

sum y@ , m(J,) on the right side of equation (89.11), there is a number m(V) on the right side of 


equation (89.10) with mv) < r%., Therefore 
eseaimeciia (89.12) 


m*(T) <= m(T) 

Suppose V is an open set in R with 7 - y. Using Definition 89.1, py = leak d,> where the /, are 
pairwise disjoint open intervals and yyy) = Dyes mU,)- If/ is finite, say J= {1,2,...,/}, define J, = 
® for all n > /. Then for either J finite or infinite, we have Te Us, Fe = nexi, and 
m(V) = .; mU,) = ©, mz). Therefore for each number m(V) on the right side of equation (89.10), 
there is a number y=, m(s,) on the right side of equation (89.11) such that mV) = 52, m(/,).. This 


implies that 
(89.13) 


mT) < m*(T) 
By equations (89.12) and (89.13) we have m(7T) = m'(T) for any 7 « y. 
(ii) Let Ube any open set in R. Theny = | J,_, 7, where the /, are disjoint open intervals and 


m(U) — y m(E,) <5 (89.14) 


cass 1. Suppose m(U) < oo. Let ¢ > 0. Then equation (89.14) implies there is some positive integer NV 
such that 


m(U) — 


a 
iM= 


m{l,) <5 
Since J, = (a,, 5,) witha, ger forn=1,2,...,N, we may let 
K, = | a+ 5m b — 53] for wee Ey Be con ot 


(Note that some K, may be void.) Then each K, is compact, and so | }*_, K, = K 1S compact. Since 
Kc U, we have 


0 < mU) — mK) = m(U) = Ym) + Ym) — m(K) 
N 
* y may — > 7 + ra by — aera] 


n=l 
N 
ae 


Ie 


€ 


r<5+578 (89.15) 


vie 


Since ¢ > 0 was arbitrary, equation (89.15) implies that m(U) < sup {m(K)| K compact and x« y}. 
Also, since x < y implies m(K) < m(U), the opposite inequality is clear. 


cass 2. Suppose m(U) = oo. Then U contains an interval of the form (— 0%, 5) or (a, ©) for some a or 
be R- SUPpose (a, co) ¢ YU for some geR. LetK, =[a+1,a+n] forn=1,2,....EachXK, is compact 
and K, < uv and sup {m(K,) |n = 1, 2, ...} =; so (11) follows. 
A similar argument applies if (a, 0) ¢ U for some 4 ¢R. Cases | and 2 complete the proof of (11). 
(iii) Let Ube any open set in R. Then gy = \),., 7. where the /, are disjoint open intervals. 


cass 1. Suppose m(U) < oo. The proof of case 1(i1) applies if we replace K, by g,, where either U, is 
void or 


E é 
U, = (a+ sera b — 52) 
In any case 77, 1s compact. Letting v = |J,.; J,» We see that (111) follows. 


case 2. Suppose m(U) = co. We may again modify (11), case 2, letting U, = (a + 1, a + n) and (iii) 
follows. 


Theorem 89.14 If U is any open subset of R, thenu e#,,. 


Proof. Let re x. We must show that (7) = m(To U)+m(ToU'). By the subadditivity of 
m, m(T) < m(T a U) + mT rr U'). The reverse inequality is obvious if m(T) = 0. Therefore, assume 
m(T) < o, Let e > 0. By Theorem 89.13(i) there is an open set V with 7 < yx such that m(V) < m(7) + 
é/2. By the same theorem there is an open set such that mV) < m(T) + ¢/2, 2d Vn U’ c H- Since 
m(H) < m(V rn U') + e/4. 1S Open, we may use Theorem 89.13(i1i) to get an open set W such that 
Fevay and mw) + 4 > mV nu): Now let we = yanacmy: Then Wand W are disjoint open 
sets. Since y , yt 1S a Subset of each of the sets V, H, and (#F)', it follows that yn U' ¢ W* « H, and 
SO 


0 < m(W*) — m(VnU’) < mA) - o(Va 0’) <5 


la(W) + m(W*) — [nV an U) + mV 1 UU’) 


Therefore = |m(W*) — mV in U)| + |n(W) — mV rn U)| 


é é € 
eat aro 


Combining this with the fact that w7 WU w* ce y and the fact that m is additive on disjoint open sets by 
Definition 89.1, we have 


mT) + > mV) +5 > mW W) +5 


= m(W) + m(W*) + 5 > mV aU) + mV Uv’) 


2 mT or U) + mT U’) 


Since ¢ > 0 was arbitrary, 
MAT) = mT U) + mT U0’) | 


Theorem 89.14 states that all open sets in R are in w,,; so we may conclude, since w,, 1S a o- 
algebra, that all countable unions and intersections of open or closed sets in R are in w,,. We have 
now reached our first goal, the construction of a o-algebra in R with a measure corresponding to 
length on intervals. 


Exercises 


89.1 Let Ae.#,, and eR. Prove that each set {x + r|xe A}, (—x]xe@ A}, and {xr |x A} IS In _Y,,. 

89.2 Prove that (R, .w,,, ™) 1S a complete measure space (see Exercise 86.7 for the definition of 
complete measure space). 

89.3 We say that a set Ec [a, aj 18 a perfect subset of [a, b] if E is closed and every point in £ is an 
accumulation point of E. 
(a) Prove that the Cantor set is a perfect subset of [0, 1] of Lebesgue measure zero. 
(b) “Prove that for any 6 > 0 there exists a nowhere dense perfect subset of [0, 1] having 

Lebesgue measure greater than 1 — 0. 

89.4 Let zcR. Prove that there exists a G, set s > ¢ such that m(S) = m(E). (G, set is defined in 
Exercise 47.5.) 

89.5 Prove that a subset E of R is m-measurable if and only if Eaf{—n, 2] is measurable for n = 1, 2, 


89.6° Prove that a subset EF of R is m-measurable if and only if for every ¢ > 0, there exists a closed 
set ec £ Such that m(E\F) <e. 
89.7 Asubset E of R is said to be an F”, set if Fis a countable union of closed sets. The collection 
of Borel sets B is the least o-algebra in R containing the closed sets. Prove 
(a) Bis the least c-algebra in R containing the open sets. 
(b) Every Borel set is m-measurable. 
(c) Every F’ set and every G, set is in B. 
(d) “Asubset E of R is m-measurable if and only if z= gus, where pe g and m(S) = 0. 
89.8 Let E be a subset of R. Prove that the following are equivalent. 
(a) Eis m-measurable. 
(b) For every € > 0, there exists an open set y = g such that m(U\E) <. 
(c) There exists an F’, set B and a set S of measure zero such that 4 = a\s. 
(d) There exists a G, set B and a set S of measure zero such that A = B\S. 
89.9 * Let fbe a differentiable function on [a, b]. Prove that f’ is m-measurable in [a, D]. 
89.10 Let X and Ybe (not necessarily Lebesgue measurable) subsets of R with glb 
{|x — ylxe X, ye ¥} > O. Prove that m(xu Y) = m(X) + mY). 
89.11 Prove that a continuous function on an m-measurable subset E of R is m-measurable. 
89.12 (a) Let fbe an increasing function on an m-measurable subset F of R. Prove that fis m- 
measurable. 


(b) Let g be an m-measurable function on an m-measurable subset EF of R and suppose that f 
is an increasing function on a set containing the range of g. Prove that f° g is m- 
measurable. 
89.13 Let E be a bounded, m-measurable subset of R and let fbe an m-measurable function on E. 
Prove that for every ¢ > 0, there exists an m-measurable subset A of E such that m(A) < « and f 
is bounded on F\A. 


90. Lebesgue Measure on [a, b| 


Let [a, b] be any closed interval in R. We have the o-algebra /w,, in R and the positive measure m on 
M,, (see 89.12 through 89.14). 


Definition 90.1 Let [a, b] be a closed interval in R. Define 
Mla, 6) = {Sm [a, 6) | Se M3 


Now [a, 6] ¢.#,, Since [a, b]’ is open in R. Therefore, § 4 [a, b}e #,, for all Se.#,,. Since yw, 1S a o- 
algebra in R, we conclude that w,[a, b] is o-algebra in the set [a, b] (verify). Also since m is a 
positive measure on w,,, 1S a positive measure on w,,[a, b] (verify). 


Definition 90.2 The positive measure space ([a, b], w,,|a, 5], m) is called the Lebesgue measure on 
[a, b]. 

In Section 57 we introduced the concept of a subset of [a, b] having measure zero. It is now clear 
from the definition of m that a subset A of [a, b] has measure zero if and only if 4 - M fa, 5] and m(A) 
= 0 (see Theorem 89.7). From Section 57 we may therefore conclude that every countable subset of 
[a, b] is of m measure zero and the Cantor set in [0, 1] is of m measure zero. 

Recall that a property P is said to hold almost everywhere on [a, b] if the set of points where P 
does not hold has measure zero. Therefore, we have that m-almost everywhere coincides with the 
concept of almost everywhere. 

({a, bl, ,,[a, 5], m) 1s a positive measure space; so by Section 88 we have an integral Ja f dm 
defined on a subclass of the class of all .w,,[a, b]-measurable functions on [a, 5]. Thus the theorems 
of Section 88 are valid for this integral. We call this integral the Lebesgue integral on [a, b], and we 
call the functions in y([a, b], w,,[a, 5], m) (Definition 88.3), the Lebesgue integrable functions on 
[a, b], denoted y[a, b]. 

We now fill in the important link between the Riemann integral and the Lebesgue integral on [a, 5]. 


Theorem 90.3 If fe @fa, b], then fe La, b] and 
X = {x e€[a, b] | fis continuous at x} 


Proof. Suppose fe @a, b]. To prove that fe @fa, b], it suffices (Theorem 88.4(i11)) to show that fis 
measurable. 
Let V be an open subset of R. Let 


fe £[a, 8] 


For each xeX¥nf-V) there exists an open interval U. such that yey ¢ fo): Now 


U =u {U,|xeXaf-'(V)} is open and thus measurable by Theorem 89.14 and Definition 86.1. By 
Theorem 58.5, X’ rm [a, 6] has measure zero and since 


f UW\U < X' a [a, 4] 


it follows that f'(V)\U also has measure zero. By Theorem 89.7, f''(V)\U is measurable. Thus 
f7(V) =[f-10\U] uv uv 1s measurable by Theorem 86.5(1i). Therefore f is measurable and 
fe £[a, 8). 

Now we wish to show that §® f(x) dx = fram fdm- 

First assume that fe Aa, B] and f(x) = 0 for all x in[a, b]. Let P= {x), x,,...,x,} be a partition of 
[a, b]. Let 


n-1 


"ims p> MA px pea xd) + Mad xn 1x0] 
t= 


where m, = glb {f(x) | xe [x;_-1, x)} for?=1,2,...,7. 
Since each of the intervals [x,_,, x,) fori=1,2,...,-— 1 and [x,_,, x,] 1s measurable, s is a simple 


1 


measurable function on [a, b]. Now 0<s <f; so by Definition 88.2, we have 


sm < | fdm 


[a,b] 


K(f, P) = Y, mee —X%-1)= | 


[a,b] 
for every partition P of [a, b]. By Definition 51.3, we have 


[fo dx < | fdm 
a {4,5} 


Let fe ¥[a, 6]. Since fis bounded, there exists a number / such that 0 < f(x) + M for all x in [a, 5]. 
By the above argument, we have 


b 
| (f(x) + M)dx < | (f + M) dm 
a (a,b) 
which reduces to 
b 
| fs | fam 
é [2,6] 
Repeating the argument above for —f, we have 


b 
| ~fix) de < | (=f) am 


[a,b] 


which reduces to 


[£09 dx > | Ps 


[a 


Therefore, (f(x) dx = fra. fdm for all fe @fa, 5]. m 
Exercises 


90.1 Define f,(%) = 1X01) On [0, 1]. Prove that {f,} converges pointwise to f(x) = 0 on [0, 1] and 
that each function f, and fis in y[0, 1], yet 


he| of 


lim 
no J[0,1} [0,1] 


Explain why each convergence theorem (Theorems 88.6, 88.13, and 88.15) does not apply 
here. 
90.2 Let n be a positive integer. Select the unique positive integer i such that 27' <n < 2'—1.Letr 
=a. 
Let f. = [277 + (7/2'7), 271 + (r+ 1)/2"')] on [0, 1]. 
Let f(x) = 0 on [0, 1]. Prove that 
(a) fe %fo,ijforn=1,2,.... 
(b) lim, ... le in I iJ 
(c) lim, ..f,(x) does not exist for any x € [0, 1]. 
Prove that there exists a subsequence {f,,} of {7,} such that (f,} converges to fm-almost 
everywhere. 
90.3° Let fe ¥fa, 6]. Define 


F(x) = fe f xelad 


Prove that F'is absolutely continuous, uniformly continuous, and of bounded variation on [a, 
b]. (The definition of absolute continuity is given in Exercise 56.1.) 
90.4 (a) Prove that y[a, b] is a vector space if we define operations pointwise. 
(b) Prove that for fe fa, 5] 


Wf = J blame 
defines a norm on the vector space y|a, b], except that |j/j = 0 implies f= 0 is replaced by |j/jj 
= 0 implies f= 0 m-almost everywhere. The space y[a, b] with this norm is often denoted 
g'[a, 5]. 
(c) Let ge #{a, 6], where g = h m-almost everywhere and / is bounded. (In this case, g is said to be 
essentially bounded.) Define 


T)=| fo fe Lia, 6] 


Prove that 7 is a continuous linear functional on g[a, b]. (Actually, every continuous linear 


function on y[a, b] is of this form, but the proof is rather involved. (See Hewitt and 
Stromberg, 1965.) 


90.5 (a)’ Suppose ¥ | f| € @[e, bj for each c satisfying a < c < b and that the improper Riemann 
integral jt. |f| converges. Prove that fe £fa, 6] and that 


rent [of 


(b) Use (a) to compute f,, .,¢, where 


fey = {Ua 0<x<1 


90.6 State and prove a result similar to that of Exercise 90.5(a) for improper Riemann integrals of 
the first kind. 


90.7 Let fbe a bounded function on [a, 5]. Fix a nonnegative integer n. Let A=(b — a)/2”" and x, = 
a+iA fori=0,1,...,2”. Define 


m, = glo {f(x)|x € (x:~1, xD} 
= lub {f()|x € (x1_1, x} 


and for x ¢[a, 6], define 


Lx) = tee X€ (X;-1, %1) 


otherwise 
_ {M; XE (X1~1, Xi) 
ae tie otherwise 
(a) Prove that L(x) <ZL,,,(4) < U4) < U(x) forn=1,2,.... 
(b) Prove that L, and U, are measurable functions for n = 1, 2, . 


(c) Prove that {Z,} and {U,} converge pointwise to measurable ‘anions (hereafter, 
denoted L and U, respectively). 
(d) Prove that fe @fa, 5], 1f and only if L(x) = U(x) m-almost everywhere on [a, 5]. 
(e) Prove that ifx #x, for any i corresponding to any n, then L(x) = U(x) if and only if fis 
continuous at x. 
90.8 Let fbe a bounded, measurable function on [a, b]. Let (¢, 2) = f(a, 6). Let 


Prc=Yy <<< m=" 


be a partition of [c, d]. Let E,=f'([y_,, y)), m, = glb E,, and M, = lub E.. Define 


Lf,P)= Zi mmlE) — UGP) = 3X ManlED 


(a) Prove that the set 
{L( f, P)| P is a partition of [¢, d]} 


is bounded above and that the corresponding set for U(f, P) is bounded below. 
(b) Prove that if P and S are partitions of [c, d] with 5 = p, then 


LAP) < LFS) s US) sus, P) 
and that for any partitions P and S of [c, d], we have 
Lf, 8) <= US, P) 
Define 


£2 f= lub (Lf, P)} 
Bf = glb {UU P)) 


(c) Prove that yif= fran f= Ff. 

90.9° Let F(x, y) be a function on [a, b] x (c, d) and suppose that for each , ¢ [a, 4], the function 
gly) = F(x, y) 1s differentiable on (c, d). Letting D,F (x, y) = g',(v) suppose further than for 
some M, |D,F(x, y)| <M for all x €[a, 6] and ye(e, d) and » e(¢, d). Suppose also that for each 
y e(e, d) the function f(x) = F(x, y) is m-measurable in [a, b]. Set G(v) = Dis F(x, y) dm(x) 
and prove that G'(v) =|, ,, D(x, y) dm(x). 


91. The Hilbert Spaces 7’(X, .”, 1) 


We complete our text with a discussion of a large class of Hilbert spaces. 


Definition 91.1 Let (X, .y, 4) be a positive measure space and define ¢*(X, -w, u) = {f|fis a real 
measurable function on X and | IP du < «, with the identification that f= g if and only if f = g almost 
everywhere on X}. 

We shall prove that y’(X, -g, ju) is an inner product space and is complete, i.e., that ¢7(X, wy, ) is 
a Hilbert space. 


Lemma 91.2 If fg « 7(X, , » then fg e Y(X, M, p)- 
Proof. By Theorems 87.4 and 87.8 |fg| 1s measurable. Let 


A= {xeX| fl = lag} 


Then 4 ey and 


0< | al du = | Lal du + | Lal dy < | LAP du + | lal? du 
xX A A’ A A’ 


< | if? du + | witaexes 
x 7 


Therefore, fge ¥(X, M,u)- i 


Theorem 1.3 ¢°(X, .g, 4) is an inner product space with inner product 
(ha=| fod forall f,ge2%%, Mu) 


Proof. Using Lemma 91.2 and the properties of the integral everything follows as long as we can 
show that ¢°(X, w, 4) is a vector space. The only difficulty is in proving that if f g « ¥7(x, .#, y) then 
f+geL(X, mM, y)- But using Lemma 91.2 again, 


[lr al au < | Uf dy + 2 [ fal du + | lal? de < 0 
xX x Xx hy 


Note that with our identification, (f, f) = 0 if and only if f= 0 almost everywhere on X. 
We also note that in y*(X, w, “) we have |jfij = (J, fF du)? and that the Cauchy-Schwarz inequality 


can be written as J, fg| du < Willigi| for all £ ge 970K, MH, p 
Theorem 91.4 ¢°(X, Vg, ) is a Hilbert space. 


Proof. We must show that y’(X, .g, 4) is complete. Let {f} be a Cauchy sequence in ¥7(X, @, /). 
There is a subsequence { f,,}7., withn, <n, <- - - such that 


91.2 
un —hil<q  forf= 2... re) 


k a 
Set %™ Ps Foss —Sujl and = py Lai Sas 

= j= 
By equation (91.2) and using the fact that the triangle inequality holds for |j-|], we see that jj¢,jj < 1 for 
k=1,2,.... Now using Theorem 88.14 (Fatou's lemma), we have 


oa Z & 2 
lol? =| » ecom fl au = | Ties int ( 5 (Fis - fa) cy 
X|j=1 X kw ji 


k a 
é tim int ( (s oe ful) du = lim inf hg,l? <1 
K \j=1 k>0 


k> oo 


Therefore |jgjj < 1. This implies, in particular, that g(x) < 00 a.e. on_X; so that the series 


ful2) + ¥ Lays) ~ Lf) (91.3) 


converges absolutely for almost all +e. Denote the sum in equation (91.3) by f(x), for all those x at 
which (91.3) converges and set f(x) = 0 on the remaining set of measure 0. Since 


fon +E Usps i in 


we see that 


Ae) = lima fx) 


for almost all x in_X. 
We now prove that fis the limit of {f,} in g*(X, .g, ). Let ¢ > 0. There exists an N such that jf, — 
fnl| < € for all m, n > N. For every m = N, Fatou's lemma shows that 


| [f— fl? du < lim int | fe, — fal? du < & (91.4) 
x jroo x 


From equation (91.4) we conclude that 


h =f — fye LX, M, pd) 


Therefore, f= f, + he £7(X, mM, yw). Equation (91.4) also gives us that |f— f,,|| > 0asm— oo. @ 

We turn to a familiar example, ([a, 5], ,,[a, 5], m), Lebesgue measure on [a, b]. (See Definition 
90.2.) We shall be interested in ¢?([a, 6], .w,,[a, b], m), which we shall abbreviate to y’[a, 5]. 

By Theorem 90.3, &f[a, a + 2x] < ¥?[a, a + 2n} SO that the trigonometric set {g,} 1s a subset of ¢'[a, 
a+ 27]. Since the Riemann and Lebesgue integrals agree for Riemann integrable functions, {g,} is an 
orthonormal set in y*[a, a + 22]. Therefore, we may develop Fourier series in y*[a, a + 27] relative 
to {g,}. In fact, throughout the remainder of this section, we will assume that all Fourier series are 
relative to this orthonormal set. Our immediate goal will be to show that the trigonometric set is a 
complete orthonormal set in y’[a, a + 22]. Along the way we shall derive a result (Theorem 91.6) 
which is interesting in its own right. The proof that {y,} is complete in ¢*[a, a + 27] (Theorem 91.7) 
parallels the proof of Theorem 78.5. 


Theorem 91.5 If se vg, 4] and € > 0, there exists a simple function he Y?[a, 6] Such that |jf — Ajj < e. 


Proof. First suppose that fis nonnegative on [a, b] and ¢ > 0. By Theorem 87.10 there exists an 
increasing sequence {s,} of nonnegative simple functions such that lim, .,. s(x) = f(x). Now |fx) — 
s,(x)P < [(x)P and since f? ¢ ¥fa,b], we may use the Lebesgue dominated convergence theorem 
(Theorem 88.15) to conclude that 


Kim | if- iP = | lim |f — 5, = 0 
[a,b] [a,b] 


a> oc n 7c 


In particular, there exists n such that |jf— s,]| <¢. For an arbitrary f? ¢ ¥[a, 5] and ¢ > 0, choose simple 
functions s and t, as above, such that jf — sj < e/2 and |jf — tj] < e/2. Then h = s — ¢ is a simple 
function and 


If- All = 10" -—f-)-@-th sdf* -sl +f —-tl<e 


It follows from the next result that the completion, in the sense of Theorem 46.7, of R[a, b] relative 
to the norm | f= (J £2)*, 18 ¢’[a, 5]. Similarly (see Exercises 91.4 and 91.5), it can be shown that the 
completion of R[a, b] relative to the norm jij = J is y[a, 5]. 


Theorem 91.6 If ? « ¥{a, 4] and € > 0, there exists a step function g € fa, b] such that |jf— gl] <e. 


Proof. First assume that f = y,, a characteristic function, where E is a measurable subset of [a, 5]. 
Let ¢ > 0. By Theorem 89.13(i) there exists an open set U such that z < y and m(U) < m(E) + 7/2. 
We may write y= (J@, U, where {U,} is a collection of pairwise disjoint open intervals. Since 
mU) = Y%., m(U,) and m(U) is finite, the series y= , m(U,) converges. Therefore, there exists N such 
that 7° v4, m(U,) < «2/2. Lety = | J¥_, u,. Then y, is a step function. We will show that |v, — x,|| < €. 

First, note that since p\E c U\E, m(V\E) < m(U\E) < 27/2. Also, since E\V & | )2.y41 Up, m(E\V) < 67/2 
.Ift =|y,-x7,’, then 


\ t= | t+ | Li-- | i+ | t 
[a,b] [a,6]\(¥ ve) V\E E\W Env 


- | r+ | t= [ 1+ | 1 = m(V\E) + m(E\V) < &* 
V\E EY VIE, EY 


Therefore, |v, — x_] < €. 

Now let f be an arbitrary function in ¢’[a, b] and let ¢ > 0. By Theorem 91.5 there exists a simple 
function 4 ¢ ¥?[a, b] Such that \jf— hy < e/2. We may write h = Yt_, qx, Where c, #0 fork=1,...,n. 
By the special case above, there exist step functions g, such that ||g, — x2,\| < e/(2nlq|). Now 
g = Yihe1 Gg, 1S a Step function and 


If — gill < If— Al + lA -— gh =1f- All + 


» CEXE, > Crk 
k=1 k=1 
“i € = € 
<If—- Al + 2, lexlllXe, — Gull < 5 + » lexl ategl =e 
We can now prove that the trigonometric set is complete in y’[a, a + 27]. 


Theorem 91.7 The trigonometric set {g,} is a complete orthonormal set in y*[a, a + 27]. 


Proof. Let fe ¥7Ja, a + 2m] and let {s,} be the sequence of partial sums of the Fourier series of f Let 
é > 0. By Theorem 91.6 there exists a step function g e @[a, a + 2x] such that 


& 
If- al <5 


Let {t,} be the sequence of partial sums of the Fourier series of g. By Theorem 78.5, lim,_,,, |Ig — ¢,]| 
= (). Thus, there exists a positive integer N such that ifn > N, 


&€ 
lg a tl < 9 


By Theorem 75.5. 


If- si s If 4ll 


Thus, ifn = N, 
If— sil < If— 4 IF all + la — all <5 + 
Corollary 91.8 Let £ ge ¥7[a, a + 2x]. Suppose 
2 + s (a, cos nx + 6, sin nx) 
is the Fourier series of f and 
Sa 5 (c, cos mx + d, sin nx) 


is the Fourier series of g. Then 
‘ ant «6 1 at2n 
(i) 4 FS ue thd) = [sa 
n=l 7 


(11) (Parseval's theorem). 


(iii) If 


‘at+2nx at2cz 
| F(x) cos nx dm = 0 = | f(x) sin nx dm form = 01,2... 


then f= 0 almost everywhere in [a, a + 27]. 
(iv) Iffand g have the same Fourier series, then f = g almost everywhere in [a, a + 27]. 


Proof. The proof follows immediately from Theorems 91.7 and 75.10. 

It follows from Bessel's inequality (Theorem 75.6) that if fe ¥7fa,a + 22] and a, = (f, 9,), then 
{a,} ¢{?. The converse is known as the Riesz-Fischer theorem (Theorem 91.9) and answers 
affirmatively a question raised in Section 78: If {¢,} ¢/?, does there exist a function fin gy’ [a, at 27] 
such that (f, 9,) =a,? 


Theorem 91.9 (Riesz-Fischer Theorem) Suppose {g} ¢/*, then there exists an fe #[a, a + 2x] Such 
that a, = (f, 9) for all n. 


Proof. We look at the sequence of functions 


k 


i= Lins fore 24: 355 
a= 


By Theorems 75.3 and 75.4, we have | f, — f,||? = Y%..4, a2 for all n > m, and this implies that {f,} is 


a Cauchy sequence in ¢’[a, a + 27]. Since y’[a, a + 27] is complete (Theorem 91.4), we conclude 
that there exists fe ¥[a,a + 2x] such that {f,} converges to f; in fact, clearly =", 2,6, Now 
Cf. by) = (Weve bes bn) = E20 (ad, %,) = a, forn=0, 1, 2,...by Corollary 75.2. ™ 

If we define T: y’[a, a+ 2z] > F by T(f) = {(f, @,)}, Bessel‘s inequality (Theorem 75.6) assures 
us that the image of 7 is contained in 7. Parseval’s theorem (Corollary 91.8(ii)) tells us that 7 
preserves norms, |jf|j = ||7(/)||. In particular, Tis one to one. The Riesz-Fischer theorem (Theorem 
91.9) states that T is onto. Thus, as Hilbert spaces, y*[a, a + 27] and /’ are, ina sense, identical. 


Exercises 


Throughout these exercises, (X, .w, 4) denote a positive measure space. 

91.1 Prove that iff — fin ¢°(X, yw, 1), there exists a subsequence { f,,} such that f,, — ¢ almost 
everywhere. 

91.2. Do Exercise 91.1 with ¢?(X, yw, u) replaced by ¢(X, g, L). 

91.3“ Prove that [a 5] ¢ ¥[a, 6] and that containment is proper. 

91.4° Prove that y(X, wy, ) is complete in the norm jjfij = [IA 

91.5° Show that the completion of R[a, b] in the norm || yj = j¢} f| is fa, 4). 

91.6 Prove that if se vg, 4] and € > 0, there exists 4 ¢ CP{a, 6] with jf — hj < e. Show that this 
statement remains valid if “CP[a, b]” is replaced by “polynomial.” 

91.7 Prove that if se fa, 4] and ¢ > 0, there exists a step function / with |jf— hj < e. Show that this 
statement remains valid if “step-function” is replaced by either “CP[a, b]” or “polynomial.” 

91.8 Give the details of the argument which shows that if we define T: ¢°(X, yw, u) > P? by Tif) = 
{(, @,,)}, then Tis one to one and onto and |j/jj = ||7()]}. 

91.9" Prove the following version of the Riemann-Lebesgue lemma. If fe ¥? [a, a + 22} then lim, 
(f, 9,) = 9. 

91.10 (a) Let ge ¥7[2, a + 2a}. Prove that 7(f) = (f g) defines a continuous linear functional on y’[a, 
a+ 2r]. (That is, re ¥[a, a + 2x]*.) Prove that |{7]] < |Ig]]. 

The remainder of this exercise is devoted to showing that if ge ¥7[a,a + 2x}, then T is of the form 
T(f) = (f, g) for some ge ¥7Ia, a + 22] and |{7|| = |\gi}, so that, in effect, the dual space y’[a, a + 27]" is 
yg [a, a+ 2rz] itself. Assume re #[a, a + 2z]*. 

(b)° Set x, = 7(g,). Show that if se v7[a, a + 2n}, then 77) = N2.F dx. The convergence of the 
series 1s part of the conclusion. 
(c) By considering the functions 4, = Y4_, x,¢, and the inequality |7(/,,)| < ||7]] |, |], prove that 
(x,}e 2? and fix, 51] S Zh 
(d) Use the Riesz-Fisher theorem (Theorem 91.9) to obtain ge ¥? [a, a + 2x] With x, =(g, @,). 
Prove that 7(f) = (f, g). 
(ec) * Prove that |j7|| = |[gif. 
91.11 (a) Prove that if (¢} ¢/?, there exists fe va, a + 2] such that (f, g,) =a, forn=1,2,.... 
(b) Prove that th fe ¥[a, a + 22] such that (77, 4,)} ¢ F. 
91.12° Prove that if se ¥{a, 5] and ¢ > 0, there exists an m-measurable set E with m([a, b]\E) < «such 
that /|E 1s continuous. 


Appendix: Vector Spaces 


In this brief appendix we summarize some of the key definitions and theorems concerning vector 
spaces which are used in this text. 


Definition. | Let F be a field. A vector space V over a field F is the pair (V, F) together with 
operations +: V x V— Vand: : F x V— V satisfying 

x+y=y+xforallx,yeV. 

x+(y+z)=(«+y)+z forallx, yzeV. 

There exists 6 € V such that x + 0 =x for allxe V. 

For each x € V, there exists y € V such that x + y = 0. 

c(dx) =(cd)x for allc, dé F;xe€ V. 

lx =x for all x € V, where 1 is the multiplicative identity for F. 

c(x + y)=cx + cy for allce F3x, ye V. 

(c+d)x=cx+dxforallce, de Fjxe V. 
We call V the set of vectors and the operation +: V x V— V vector addition. We call F the set of 
scalars and the operation :: F x V — V scalar multiplication. When the field F is understood, we 
speak of the vector space V. We also note that a vector space V is always nonempty since 0 € V. In 
case F = R, we call V a real vector space. Throughout the remainder of this appendix we shall 
assume that all vector spaces are real vector spaces. 

If X is a set and F, is the set of real-valued functions on X, then J, is a vector space if we define 
vector addition and scalar multiplication pointwise: 


ot Ss et ae 


(f+ aXD=fO+9~) figeFysxeX 
(ef (x) = ef(~) ceER; feF x 


Most of the vector spaces considered in this text are subsets of J, for some set X. For example, if we 


let X= {1,2,...,n}, F, is the vector space R”. It can be shown that any (real) vector space is 
essentially a subset of F , for some set_X. 


Definition. Let V be a vector space and X C V. We say that X is linearly independent if whenever 
{X,,...,X,} 18 a finite subset of X and for scalars c,,...,c, we have c.x, +: °°: +c,.x, = 6, it 
follows that 


QO=¢, =e, == 


The set X 1s linearly dependent if it is not linearly independent, that is, if there exists a finite 
subset {x,,...,x,} of X and scalars c,,...,c,, not all zero, such thatc,x, +: -:+¢,x,=0. 


Definition. Let WX C V. If for every element w € W, there existx,,...,x,E€Xandc,...,c¢,€ 
Rsuch that 


We 6X, tee + CX, 
we Say that _X spans W. 
Definition. A subset XY C Vis a basis for V if X is a linearly independent set and_X spans V. 


Theorem. A subset XY C V is a basis for V if and only if every element v € V may be written uniquely 
as 


B= €;% Sil wl CX 
where C4.c2.5¢, € Rand X45 22.25%, 6X. 


Definition. A vector space V is finite dimensional if V = {@} or if there exists a basis X for V, 
where_X is a finite set. 


Theorem. If Vis a finite dimensional vector space and V4 {0}, then every basis for V is finite and 
any two bases have the same number of elements. 


Definition. If Vis a finite dimensional vector space, V# {0}, and_X is a basis for V, we define the 
dimension of V to be the number of elements in_X. If V = {0}, we define the dimension of V to be 
zero. 


Theorem. The (vector space) dimension of R” is n. 


Theorem. Letx,,...,x,€R". The following are equivalent. 
(i) {x,,...,x,} 18 a basis for R". 

(1) {x,,...,x,} spans R”. 

(i11) {x,,...,x,} 1s a linearly independent set. 


Definition. If WC V, we say that Wis a subspace of V if W itself is a vector space. 


Theorem. Wis a subspace of Vif and only if whenever x, ye Wandce R,x + cye W. 
Throughout the remainder of this Appendix V, and V, will denote real vector spaces. 


Definition. A /inear transformation T from V, to V, is a function 7: V, — V, satisfying T(x + cy) = 
(Tx) + c(Ty) for x, ye V, andce R. 


Definition. A linear functional on V, is a linear transformation from V, to R, where R is 
considered a vector space over itself. 


Definition. Let ¢'(V,, V,) denote the set of linear transformations from V, to V,. If7 Ve ¢'(V,, V,), 
c€R, and ve V,, we define 


(T + U)v) = (Tv) + (Uv) 
(cT)(v) = c{Tv) 


Theorem. ¢(V,, V,) with vector addition and scalar multiplication defined as above is a real 
vector space. 


Theorem. If7e ¢(V,, V,) and Se ¢g'(V,, V;), then the composition S° Te ¢'(V,, V;). (Of course, 
V, denotes a real vector space.) 
The composition S ° 7 is ordinarily written ST. 


Definition. If 7e€ ¢'(V,, V,) and T is one to one and onto, we call T a (vector space) isomorphism 
and we say that V, and V, are isomorphic (vector spaces). 


Theorem. Let V be a vector space. V is isomorphic to R” if and only if V is n-dimensional. 


Definition. If Te g'(V,, V,) and there exists S € v'(V,, V,) such that TS is the identity on V, and ST 
is the identity on V,, we say that T is invertible. In this case we denote S by T'. 


Theorem. Let 7 € ¢’‘(R’, R®). The following are equivalent: 


(i) Tis anisomorphism. 
(11) 71s one to one. 

(i411) Tis onto. 

(iv) Tis invertible. 


Definition. If 7 Ue v'(V,, V,) and there exists an invertible Se ¢'(V,, V,) such that T= S'' US, we 
say that 7 and U are similar linear transformations. 


Definition. Suppose that 7€ ¢'(V,, V,) and there exists a nonzero vector x and a scalar c such that 
Tx = cx. We call c an eigenvalue and x an eigenvector of T. 

Good references on linear algebra are Halmos: Finite-Dimensional Vector Spaces (1974), 
Herstein (1975), Hoffman and Kunze (1971), and Strang (1976). 
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Hints to Selected Exercises 


Section 5 
5.9 Argue by contradiction. Then there exist c, d € (a, b) with c < d and f(c) = f(d). Now consider 


lub {x | a < x < dand f(x) > f(d)} 


Section 6 


6.6 Suppose S(n) is false for some n and consider the smallest such n (Theorem 6.10). 


Section 7 


7.9 R’' possesses a set of positive integers P’ by virtue of Definition 6.3. Let P’= {1', 2’,...}. We 
may define 


, 


0 {f 


geP’*,pePU-P’u (03} 


If we define f(p/q) = p'/q', fmaps Q onto Q’. 
Ifx € R, define 


f(x) = lub (f(r) |r < x, re Q} 


Show that fhas the desired properties. 


Section 8 
8.4 Use Exercise 8.3. 
Section 9 


9.7 Use induction on n. 

9.8 Use Exercise 9.7. 

9.9(c) Use Exercise 9.8. 

9.10 Suppose the plane can be written as (J#.,z,, where each L, is a straight line. Show that there 
exists a real number ¢ such that the line L: y = ¢ is different from L, for every n. Consider L 
(ee Te Dae: 


Section 16 


16.11 Setd,=n'"—1. Thenn = (1 + 6," > 4am — 1962, 2 > 2. Thus 52 < 2/1 — 1), n = 2. Now show that 
lim,_,., 6, = 0. 

16.16(a) Divide both sides of the equation by a,,,,. 

Section 17 


17.3. Use Exercise 17.2 and Theorems 17.4(v1) and 14.3. 


Section 18 


18.2 | Consider the bounded and unbounded cases separately. 
18.3. Argue by contradiction. 

Section 22 

22.4 J ae 


nn -- 1) on n+l 
Section 23 
23.2 See Exercise 22.4. 


Section 24 


24.3. Compare the series 72, 1/n? and 72, I/n(t + 1). 
24.9 Consider s,,—s,. 


n 


Section 25 
25.5(d) Use 25.5(c). 
Section 26 


26.1(h) Assume that >, (n!/ — 1) converges and then use Exercise 24.9 and inequality (16.1). 
26.1(1) Expand (1 + 1/n)" by the binomial theorem and show that e — (1 + 1/n)" > 1/2n, n> 2. 
26.1(j) Show that 


3-5 < 
2+4-6- ++ (27) vat+il 


26.6 Consider the series m2, p, and y#, g, in conjunction with Exercise 22.8, where p,, and g,, are 
defined as in Theorem 26.2. 

26.10 Leta, be the greatest of 0, 1, 2,..., 9 such that a,/10 <x. Let a, be the greatest of 0, 1, 2,... 
, 9 such that (a,/10) + (a,/10’) < x. Continue in this way and then prove that r=. , a,/10" = x. 

26.11 To derive the right-most inequality, write 


See ee en ee er 
Reem teeateraerat ) 


and compare the resulting series with 


1 1 nr 
i+i+2tGt+opt 


Section 29 


29.11(c) Use part (b). 
29.13(a) Consider the sets |x|, = {|x| | x¢X and |x| > 1/n}. 


Section 33 
33.6 Use Exercise 32.5 and Theorem 32.2. 
Section 36 


36.6 Examine the proof of Theorem 36.1. 
36.7 | Complete the square. 


Section 37 


37.11 Suppose jim,.,., a = a, for every positive integer n. Choose a positive integer M such that 
Das 2/2" < 2/2. Show that there exists a positive integer N such that if k > N, then 


Hla — ay, 
nei yi 


eed 
<3 


Deduce that if k > N, then d(a”, a) < ¢. The proof of the converse is similar to the proof of 
Theorem 37.3. 
Section 40 


40.14(d) Use (c) and Theorem 40.5. 
40.16(a) Use Exercise 37.11. 
40.16(b) Use Theorem 40.2. 


Section 42 


42.2 Lety eX’. For eachx €X, there exist open sets U, and V, such that U,M V, is empty, x € U,, 
and y € V.. The collection {U. | X |x € X} is an open cover of X and so has a finite 
subcover {U, (1X, ..., U,  X}. Prove that 


YE Va, N+ AV CX" 
42.12 Argue by contradiction. Investigate the minimum of the continuous function g(x) = d(f(x), x). 


Section 43 


43.3 ForneP, cover M bya finite collection of open balls of radius 1/n. Choose a point in each 
ball and let 4, be the set of points obtained. Now let X = U2; A,. 


Section 44 


44.6(e) See Exercise 35.7. 

44.6(f) Replace M by M using (e). Now use Exercise 40.16. 
44.6(g) Use (f) and Exercise 43.3. 

44.7. Use Exercise 43.4. 


Section 47 


47.6c(c) Ifsuch an fexists, we have Q = (\@, {x | s(x) < 1/n} which contradicts Exercise 47.5. 

47.7(b) Show that G, is open for every e > 0. Then ., G,,, 18 nonempty by Theorem 47.2. 

47.8 Suppose we can write [a, b] as the disjoint union of a collection of closed intervals of length 
less than b — a. Prove that the collection is countable so that we may write fa, 6] = |J%.; [am bal: 


Let x = ({a,} U{s,})\ fa, 6}. Prove that XY is a compact set with no isolated points. Use Corollary 
47.8 to obtain a contradiction. 


47.9 Set X, = {x € Rj f, is of degree n} and Y, = {y € Ry f, is of degree m}. Then 
R = 20 ¥, = U2-0¥, implies xe4 @ «¥p for some integers k and / by the Baire category 
theorem. 

Section 53 


53.3 To prove that (c) implies (a), for each positive integer n, choose a partition P”, such that if 
P",P* D P’,, then 


[SUP T*) — SU,P*, TH) <1 
Let P, =P’, U ... U P”.. Choose points T, in P,. Let a, = S(f, P,, T,). Prove that {a,} is a 


Cauchy sequence. Now let J = lim,_,.. a,,. 


Section 54 
54.10 Use Exercise 54.8(a), Theorem 54.8, and Exercise 33.6. 
Section 56 


56.5(a) Let rir) = setts — tie +) +(e — HN] and G(t) = F(t) — (t/hy F(A). Apply Rolle's theorem to G 
on [0, i] to obtain 


0= —r fe +) —fe — mM) — Gr /h FR) 


Now apply the mean-value theorem to f’ on [c — 4, c + 7]. 


56.6(a) Let rie) = fet f— (3c + 2) + 4fO +(e — 9] and G(t) = F(t) — (Why F(h). Apply Rolle's 


c- 


theorem to G, G’, and G’, then the mean-value theorem as in Exercise 56.5(a). 
56.10 Write 


ray= [ist [ie@ad—la-oreod 


Section 58 


58.2 It suffices to prove that iffe R[a, b] and f(x) = 0 almost everywhere in [a, b], then se y=o. 
Apply Theorem 51.8 to the functions max {f, 0} and —min{f, 0}. 


Section 60 


60.8 Lete > 0 and consider the sets y, = {xe M || f(x) — f,(3)| < €}- 
60.10 Use Theorem 60.7, Corollary 60.5, and Exercise 60.7. 


Section 61 

61.4 See Kestelman (1970). 
Section 62 

62.4 Use Exercise 60.8. 
Section 63 


63.5 Argue by contradiction using Theorem 63.1(iv) and Rolle's theorem. 
63.6 Use Exercise 63.5. 
63.7(c) Compute the derivative of f(x)/(1 + x)*. 


Section 64 


64.3. Use Theorems 29.9 and 64.3. 
64.4 —Imitate the proof of Theorem 64.1. 


Section 66 


66.7 Consider the derivative of e“ 7(Z). 
66.8 Consider the derivative of e~* f(x). 


Section 68 
68.9(e) Use Wallis' product given in Exercise 68.8. 
Section 69 


69.8 — Imitate the proof of Theorem 45.7. 
69.11(b) Imitate the proof of Theorem 46.7. 


Section 72 
72.6(1) Use (g) and (h) and argue by induction. 
Section 74 
74.5(d) See Exercise 66.7 and Exercise 68.12. 
Section 75 


75.6 Letx eV. By Bessel's inequality me , (x, x,)2 converges. Now use the generalized Pythagorean 
theorem and completeness to deduce that m2, (x, x,)x, converges. Let y= r@, (x,x,)x, Now 
show that x — y is orthogonal to x, for every positive integer n. 


75.8 | Use Theorem 75.5. 

Section 76 

76.7 Use Exercise 64.4 and Theorem 76.3(1). 
Section 77 


77.6 Use Exercise 77.5 and imitate the proof of Fejér's theorem. 
77.7 Let X be the set of polynomials with rational coefficients. Now use Weierstrass' theorem. 


Section 78 


78.7(a) Approximate the series 72., 1/n3 by a partial sum and compare the result to z°/m. 
78.8(a) Use Theorem 36.3. 


Section 80 


80.3. Consider a basis for R”. 


80.6 By the Weierstrass approximation theorem there exist polynomials p such that p(2) is large, 
but |j|j is small. 


Section 81 
81.8 | Use Weierstrass’ theorem, Corollary 77.10. 
Section 84 


84.6(a) Let fe C[-1, 1] with yj < 1. Then jy < 1, and thus \7(/”)j < j7j. Therefore, j7(/)j < 7”. 
Deduce |j7]j < 1. Let g(x) =x for x € [-1, 1]. Define c = 7(g). Show that c € [-1, 1]. Now 
show that if p is a polynomial, then 7(p) = p(c). Finally, use the Weierstrass approximation 
theorem to show that 7(f) =/(c) for all fe C[-1, 1]. 

(b) Let g be a linear function from [a, b] onto [-1, 1]. Define S(f) = T(f@ ¢). Prove that S € 
(C[-1, 1])° and S(f-g) = (Sf)(Sg) for f g € C[-1, 1]. Use 84.6(a) to deduce the conclusion. 


(c) If 7 1s not continuous, there exists f € Cla, b] with jj < 1 such that \7(f/)j > 1. Define g = 
f(T) —f) and note that g € Cla, b]. Show that f— g7(f) + f- g =0 and deduce that 7(f/) = 0 
which is a contradiction. 


Section 87 
87.13 Choose positive integers n, <n, <- ° - such that 
wl {x | |fG) — find] = Uk + 1} < 1/2k** 
Let Ay = U {| LFG8) — f(s] > 103 
Set § = ()\fii Ap 


87.14 Let F,,= (xy) — fx) < 1/7 for n 27}. Show that for each /, lim... u(F;,) = “(X). For each 
i, choose a positive integer j such that 


HAV) <5 


Let B= X\(\fai Fin 


Section 89 


89.3(b) Choose 1 so that 1/(m — 2) < 0. Imitate the construction of the Cantor set. First, instead of 
removing the middle third, remove the middle section of length 1/n. From each of the two 
remaining intervals remove the middle section of length 1/n? so that an additional 2/n? is 
removed. Continue inductively. 

89.6 If the condition holds, choose closed sets F, © FE such that m(E\F,) < I/n forn=1,2,.... 
Let A= UF’. Then FE = 4 U (E\A). Show that A and E\A are m-measurable. If EF is m- 
measurable, use Exercise 89.5 and Theorem 89.13(i1) to obtain a closed set FP, C £,=EN 
[—n, n] with m(E\F) <e/2”". Take F= NF". 

89.7(d) For the case when E is m-measurable, use Exercise 89.6. 

89.9 Consider the functions 


Section 90 


90.3. Use Exercise 56.1 and Exercise 88.12. 
90.5(a) Use Theorem 88.6. 
90.9  Fixy. Set 


fs) = EG + Me) — Fy) 
and apply Theorem 88.15. 


Section 91 


91.3 Write [a, 6) = {|| f@)| > 1} v Gd | £9] < 1}. 
91.4 Examine the proof of Theorem 91.4. 
91.5 Use Exercise 91.3. 
91.9 First obtain ge ¥2fa, a +- 22] 9 Ba, a + 2n] With fr+2" | ¢— gi small. Then apply Theorem 75.8 to g. 
91.10(b) Use Theorem 91.7 to write f= 52., Cf bn) 
(ec) Letn — o in part (c). 


91.12 Use Exercises 91.2 and 91.7 to produce a sequence of continuous functions {f+ which 
converges pointwise almost everywhere to f; Now use Exercise 87.14. 


Index 


Abel's lemma, 92 
Abel's limit theorem, 263 
Abel's summability, 265 
Abel's test, 91, 262 
Abel's theorem, 263 
Absolute continuity, 228 
Absolute convergence, 81, 96 
of improper Riemann-Stieltjes integrals, 240 
Absolute value, 14 
Accumulation point, 102, 131 
Addition, 10 
Additive identity, 10 
Algebraic number, 32 
Almost everywhere properties, 233, 375 
Alternating series, 80 
test, 80 
Archimedean ordering, 19 


Baire category theorem, 168 
Banach algebra, 343 
Banach space, 283 
Banach's theorem, 165 
Bessel's inequality, 305 
Binary operation, 9 
Binomial series, 261 
Binomial theorem, 20 
Bolzano- Weierstrass theorem, for metric spaces, 150 
for reals, 58 
Bonnet's theorem, 229 
Boundary of a set, 136 
Bounded: 
above, 14 


below, 14 

function, 145 

linear transformation, 337 
sequence, 45 

set, 151 

variation, 214 


Coy ta 
metric, 120 
norm, 284 
C’..1RS 
C183 
Cantor set, 232 
Cartesian product, 5 
Cauchy condition, 60 
for functions, 107 
for uniform convergence, 248 
Cauchy principal value, 239 
Cauchy product, 98 
Cauchy-Schwarz inequality: 
for inner product spaces, 290 
for /?, 123 
for R", 121 
Cauchy sequence: 
ina metric space, 159 
of real numbers, 60 
Cesaro summability, 265 
Chain rule, 174 
Characteristic functions, 348 
of a set, 29 
Closed set, 129 
Compact metric space, 144 
Comparison test, 82 
for integrals, 240 
Complement, 3 
Complete metric space, 160 
Complete orthonormal sets, 307 
Completeness: 
of Cla, b], 248 
of a metric space, 160 
of real numbers, 16 


Completion of a metric space, 161 
Composition, 6 
Conditional convergence, 90 
of improper Riemann-Stieltjes integrals, 240 
Conditionally compact, 166 
Connected metric space, 156 
Contains, 2 
Continuity, 110, 137 
absolute, 228 
uniform, 153 
Continuous function, 110 
on a metric space, 137 
Continuous linear functionals, 343 
Contraction mapping, 155, 165 
Convergence: 
absolute, 81, 96 
absolute of improper Riemann-Stieltjes integrals, 240 
conditional, 90 
conditional of improper Riemann-Stieltjes integrals, 240 
of Fourier series, 288, 300, 307 
of improper Riemann-Stieltjes integrals, 239, 242 
pointwise, 245, 253 
of a sequence, 40, 125, 245 
of a series, 74, 253 
uniform, 246, 253 
Cosecant function, 277 
Cosine function, 275 
Cotangent function, 277 
Countable additivity, 357 
Countable set, 27 
Counting measure, 358 


Decimal expansion, 87 
De Morgan's laws, 3 
Dense sets, 166 
Derivative, 171 
lefthand, 171 
nth order, 185 
of power series, 259, 260 
righthand, 171 
of series of functions, 254 


Diameter of a metric space, 152 
Difference of sets, 3 
Differentiability, 171 
Dini's theorem, 248, 258 
Dirichlet kernel, 309 
Dirichlet's test, 90, 264 
Discrete metric, 119 
Distance function, 116 
Divergent: 
improper Riemann-Stieltjes integrals, 239, 243 
infinite series, 74 
sequence, 40, 125 
to infinity, 48 
Domain, 6 
Double sequence, 93 
Double series, 93 
Dual space, 343 


é,. 51,269 
é-mapping, 169 
Element, 2 

first, second 5 
Empty set, 2 
Equivalent metrics, 141 
Equivalent sets, 26 
Essentially bounded, 395 
Euclidean metric, 117, 118 
Euclidean n-space, 120 
Euler's constant, 273 
Eventually constant sequences, 125 
Exponential function, 268 
Exponents: 

rational, 23 

real, 55 
Extended real line, 71, 356 
Extension, 6 


Fatou's lemma, 378 
Fejér kernel, 315 
Fejér's theorem, 317 


Field, 11 
Finite additivity, 358 
Finite intersection property, 147 
First category sets, 168 
Fourier coefficients, 288, 299 
Fourier series, 288, 299 
Cesaro summability of, 315 
pointwise convergence of, 308 
uniqueness of, 318 
function, 5 
bounded variation, 214 
characteristic, 29, 348 
composition, 6 
continuous, 110, 137 
cosecant, 277 
cosine, 275 
cotangent, 277 
distance, 116 
exponential, 268 
inverse, 6 
limit, 102 
logarithm, 271, 273 
measurable, 361 
one-to-one, 6 
onto, 6 
oscillation of, 235 
periodic, 154, 295 
rational, 109 
secant, 277 
sign, 348 
simple, 364 
sine, 275 
step, 323 
tangent, 277 
total variation, 214 
upper semi-continuous, 349 
Fundamental theorem of integral calculus, 225 


G, set, 169 
Generalized mean value theorem, 179 
Geometric series, 75 


Gram-Schmidt process, 295 
Greater than, 13 

Greatest lower bound, 15 
Group, 10 


H”, 120 

Hardy's Tauberian theorem, 331 
Heine-Borel theorem, 113 

Hilbert cube, 120 

Hilbert space, 291 

Homeomorphic metric spaces, 155 
Homeomorphism, 155 


Identity: 
additive, 10 
multiplicative, 11 
Image, 6 
Improper Riemann-Stieltjes integral: 
of the first kind, 238 
of the second kind, 242 
Induction, 18 
Inequality, 13 
Bessel's, 305 
Cauchy-Schwarz, 121, 123, 290 
Infimum, 15 
Infinite series, 73 
absolutely convergent, 81 
alternating, 80 
conditionally convergent, 90 
convergent, 74 
divergent, 74 
of functions, 253 
geometric, 75 
power, 87 
rearrangement, 96 
Taylor, 261 
Inner product, 288 
inl’, 289 
in R[a, b], 289 
in R”, 289 


in R*, 285 
Inner product space, 289 
Integers, 21 
positive, 17 
Integral: 
improper Riemann-Stieltjes, 238, 242 
Lebesgue, 370 
Riemann, 192 
Riemann-Stieltjes, 192, 210, 219, 238, 242 
test for infinite series, 242 
Integration by parts, 211 
Interior point, 136 
Interlacing method, 57 
Intermediate value theorem, 157 
Intersection, 2 
Interval: 
closed, 13, 356 
half-open, 13, 356 
open, 13, 356 
Inverse: 
additive, 10 
function, 6 
multiplicative, 11 
Inverse image, 6 
Irrational numbers, 21 
existence, 32 
Isolated point, 168 
Isometry, 345 


i’, 119 
metric, 119 
norm, 282 
Pig 
inner product, 289 
metric, 123 
norm, 282 
120 
metric, 120 
norm, 284 
L? norm, 291 
Least upper bound, 15 


Least-upper-bound axiom, 15 
Lebesgue's Dominated Convergence Theorem, 378 
Lebesgue integral, 370 
Lebesgue measurable sets, 388 
Lebesgue measure on [a, b], 393 
Lebesgue's Monotone Convergence Theorem, 372 
Lebesgue-Radon-Nikodym Theorem, 375 
Legendre polynomial, 295 
Less than, 13 
L‘Hospital’s rule, 182 
lim inf, 61, 69 
limit: 
as x approaches infinity, 108 
left-sided, 107 
of a function, 102, 137 
of a sequence, 35, 63, 125 
right-sided, 107 
uniqueness, 36, 105, 128 
limit point, 129 
lim sup, 61, 69 
Linear functional (continuous), 343 
Lipschitz condition, 312 
uniform, 218 
Logarithm function, 271, 273 
Lower bound, 15 
greatest, 15 
Lower Riemann-Stieltjes sum, 191 


Mathematical induction, 18 
Mean value theorem, 179 
generalized, 179 
Mean value theorem of the integral, 201 
second, 225 
Measurable function, 361 
Measure zero, 230 
Metric: 
discrete, 119 
equivalent, 141 
Euclidean, 117, 118, 121 
for c,, 120 
for /', 119 


for /?, 123 

for /”, 120 

for R, 117 

for R?, 117 

for R", 121 

from norm, 282 

relative, 142 

usual, 117, 118, 121 
Metric space, 117 

BV [a, b], 214 

Cla, b], 247 

Cy, 120 

CP|a, |, 297 

compact, 144 

complete, 160 

connected, 156 

continuous functions on, 136 

convergence in, 125 

diameter of, 152 

homeomorphic, 155 

L113 

F,i2 

I”, 120 

product, 120 

R’, 121 

separable, 152 

R[a, b], 192 
Monotone sequence, 49 
Multiplication, 10 
Multiplicative identity, 11 


Natural logarithm function, 271 
Negative real number, 12 
Norm: 

for ala, b], 282 

for cy, 284 

for /', 282 

for ?, 282 

for 1”, 284 

for R[a, b]-L?, 291 

for R[a, b], uniform, 282 


for R", 281 
from an inner product, 290 
of a partition, 206 
of a vector space, 281 
Normed linear algebra, 343 
Normed linear space, 281 
of continuous linear transformations, 339 
isometrically isomorphic, 346 
Normed vector space, 281 
Nowhere dense sets, 167 


One to one, 6 
Onto, 6 
Open ball, 132 
Open cover, 144 
Open set, 132 
Order, 12 
Archimedean, 19 
Ordered pair, 5 
Orthogonality, 285, 293 
Orthogonal sets, 286, 293 
Orthonormal set, 286, 293 
complete, 307 
Oscillation of a function, 235 
Outer measure, 385 


Pairwise disjointness, 358 
Parallelogram law, 292 
Parseval's theorem, 288, 307, 326 
partial sums, 73 
partition, 191 

norm of, 206 

refinement of, 193 
Periodic function, 154, 296 
Permutation, 96 
Perpendicularity, 285, 293 
Point, 2 
Pointwise convergence: 

of sequences, 246 

of series, 253 


Pointwise operations, 105 
Polarization identity, 292 
Positive functional, 353 
Positive integers, 17 
Positive measure, 357 
Positive measure space, 358 
Positive real number, 12 
Power series, 87 
continuity of, 259 
differentiation of, 259 
integration of, 259 
radius of convergence, 88 
uniform convergence, 259 
uniqueness, 260 
Power set, 28 
Product metric space, 120 
Pythagorean theorem: 
generalized, 308 
for R?, 286 


Radius of convergence, 88 
Range, 6 
Rational exponents, 23 
Rational function, 109 
Rational numbers, 21 
Ratio test, 84 
Real numbers, 9 
uniqueness, 24 
Rearrangement, 96 
Relative metric, 142 
Restriction, 6 
Riemann's condition, 194 
Riemann integral, 192 
necessary and sufficient condition for existence, 236 
Riemann-Lebesgue lemma, 306 
Riemann localization theorem, 311 
Riemann-Stieltjes integral, 192 
and arbitrary integrator, 210 
and functions of bounded variation, 219 
improper of the first kind, 238 
improper of the second kind, 242 


lower, 192 
upper, 192 
Riemann-Stieltjes sum, 204 
lower, 191 
upper, 191 
Riesz-Fischer theorem, 401 
Riesz representation theorem, 349 
Rolle's theorem, 180 
Root test, 85 


o-algebra, 357 
Secant function, 277 
Second category sets, 168 
Second mean value theorem, 225 
Sequence, 34 
Cauchy, 60, 159 
convergent, 40, 125 
decreasing, 49 
divergent, 40, 125 
eventually constant, 125 
increasing, 49 
limit, 35, 61, 69, 125 
monotone, 49 
pointwise convergent, 245 
real, 27, 34 
uniformly bounded, 248 
uniformly convergent, 246 
Separable metric space, 152 
Set, 1 
boundary, 136 
Cantor, 232 
characteristic function, 29, 348 
closed, 129 
countable, 27 
dense, 166 
difference, 3 
empty, 2 
equivalent, 26 
first category, 168 
G,, 169 
intersection, 2 


lower bound, 14 
of measure zero, 230 
nowhere dense, 167 
open, 132 
orthogonal, 287, 293 
orthonormal, 287, 293 
power, 28 
second category, 168 
successor, 17 
trigonometric, 294, 318, 325 
uncountable, 27 
union, 2 
upper bound, 15 
Simple function, 364 
Sine function, 275 
Squeeze theorem, 47, 49 
for functions, 107 
Step function, 323 
Subcover, 144 
Subsequence, 38 
Subset, 2 
proper, 3 
Successor set, 17 
Sum by rows (columns), 93 
Summability. 
Abel, 265 
Cesaro, 265 
Summation by parts, 90 
Supremum, 15 


Tangent function, 277 
Tauber's first theorem, 265 
Taylor polynomial, 186 
Taylor series, 261 

Taylor's theorem, 186 

Tietze extension theorem, 258 
Topology, 135 

Totally bounded, 166 

Total variation, 214 
Transcendental numbers, 32 
Triangle inequality, 117, 281 


Trigonometric set, 294 
completeness in CP[a, a + 27], 318 
completeness in R[a, a + 27], 325 
2" test, 78 


Uncountable set, 27 
Uniform bounded sequences, 248 
Uniform continuity, 153 
Uniform convergence: 

of sequences, 246 

of series, 253 
Uniform Lipschitz condition, 218 
Universe, 3 
Union, 2 
Upper bound, 14 

least, 15 
Upper Riemann-Stieltjes sum, 191 
Upper semi-continuous, 349 
Usual metric, 117, 118 


Vector spaces, 404 


Weierstrass approximation theorem, 319, 321 
Weierstrass M-test, 255 

Weight of an interval, 191 

Well-ordering theorem, 19 


Page Line Correction 
2 -12 x€Ashouldbex cA 
6 -=13 “said to an extension” should be “said to be an exten- 
sion” 
10  -3 Just before line 3 from the bottom, insert the line “It 
should be noted that x = » if and only if x — y = 0.” 
29 -1 min{f~-!(x)} should be min{ f-!({x})} 
30 -6 f(m,m) should be f((n, m)) 
47 —-3 cn sl +eshould bec, <L+e 
52  -11 Leave out the word “recently” 
56 11 “are increasing” should be “are strictly increasing” 
84 12. Replace by 


. | @ae 
L= lim | —*4 
i-~ 


exists (L = oo is allowed) 


n 


9% -5 < (& am] should be < 5° (5 an») 


n=l mel \n- 
108 ~4  x*>M (x <M) should be x > M (x < M) andx € X 
110 5 “atait" should be “ata & X if” 
151 5 “Let x € M.” should be “Let x € C.” 
153 4 “in M2” should be “in f(M))” 
158 12. “f is continuous” should be “f is (uniformly) continu- 


ous 

169 1 “a complete” should be “a nonempty complete” 

169 6 “acompact” should be “a nonempty compact” 

174 -12 “for all.x € R” should be “for all x < R (where x® = 1)” 

199 In Theorem 51.13, all Ry, should be Ry 

226 7 “F is continuous” should be “F is (uniformly) continu- 
ous” 

230 8 “f is continuous” should be “f is bounded and contin- 
uous” 


232 -8 2" should be’ 2”-! 

239 ~11 Insert “and say that {“. f de converges.” before line 
-11 

0 1 

251 5 Change | l to | 0 

251 7 Change} 9 to : 

257 7 hm should be a + hy, 

270 12 ea should be e* 

303 -10 “f is continuous” should be “f is (uniformly) continu- 
ous” 

333 14 “the terms of” should be “the terms {na,,} of” 

411 2 5.9 should be 5.8 


